Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
The staging dir used while submitting DAGs
Root Logging level passed to the Tez app master
Java options for the Tez AppMaster process.
Upper limit on the number of threads user to launch containers in the app
master. Expect level config, you shouldn't be needing it in most cases.
Number of threads to handle job client RPC requests
Range of ports that the AM can use when binding. Leave blank
if you want all possible ports.
The amount of memory to be used by the AppMaster
public static final float
The complete path to the serialized dag plan file
. Used to make the plan available to
individual tasks if needed. This will typically be a path in the job submit
The maximum heartbeat interval between the AM and RM in milliseconds
The maximum amount of time, in milliseconds, to wait before a task asks an AM for another task.
Whether to scale down memory requested by each component if the total
exceeds the available JVM memory
The fraction of the JVM memory which will not be considered for allocation.
No defaults, since there are pre-existing defaults based on different scenarios.
Configuration to specify whether container should be reused.
Whether to reuse containers for rack local tasks. Active only if reuse is
public static final boolean
Whether to reuse containers for non-local tasks. Active only if reuse is
public static final boolean
The amount of time to wait before assigning a container to the next level
of locality. NODE - RACK - NON_LOCAL
TEZ_AM_PREFIX + "container.reuse.locality.delay-allocation-millis";
The amount of time to hold on to a container if no task can be assigned to
it immediately. Only active when reuse is enabled. Set to -1 to never
release a container in a session.
The location of the Tez libraries which will be localized for DAGs
The multiplier for available queue capacity when determining number of
tasks for a Vertex. 1.7 with 100% queue available implies generating a
number of tasks roughly equal to 170% of the available containers on the
Upper bound on the size (in bytes) of a grouped split, to avoid generating excessively large splits.
Lower bound on the size (in bytes) of a grouped split, to avoid generating too many splits.
Time (in seconds) to wait for AM to come up when trying to submit a DAG
from the client.
Time (in seconds) for which the Tez AM should wait for a DAG to be submitted before
The queue name for all jobs being submitted as part of a session, or for
non session jobs.
Comma separated list of containers which should be profiled.
The string to be added to the JVM command line for containers being profiled.
The service id for the NodeManager plugin used to share intermediate data