Using Ambari Views
Also available as:
PDF

Configure YARN workflow queues

To configure a queue:

  1. Click the queue name.
  2. Set the following queue parameters:
    Hover the cursor over a parameter name to display a description of the parameter.
    Capacity
    Capacity
    The percentage of cluster resources available to the queue. For a sub-queue, the percentage of parent queue resources.
    Max Capacity
    The maximum percentage of cluster resources available to the queue. Setting this value tends to restrict elasticity, as the queue will be unable to utilize idle cluster resources beyond this setting.
    Enable Node Labels
    Select this check box to enable node labels for the queue.
    Access Control and Status
    State
    Running is the default state. Setting this to Stopped lets you gracefully drain the queue of jobs (for example, before deleting a queue).
    Administer Queue
    Click Custom to restrict administration of the queue to specific users and groups.
    Submit Applications
    Click Custom to restrict the ability to run applications in the queue to specific users and groups.
    Resources
    User Limit Factor
    The default value of "1" means that any single user in the queue can at maximum only occupy the queue’s configured capacity. This prevents users in a single queue from monopolizing resources across all queues in a cluster. Setting the value to "2" would restrict the queue's users to twice the queue’s configured capacity. Setting it to a value of 0.5 would restrict any user from using resources beyond half of the queue capacity.
    Minimum User Limit
    This property can be used to set the minimum percentage of resources allocated to each queue user. For example, to enable equal sharing of the queue capacity among five users, you would set this property to 20%.
    Maximum Applications
    This setting enables you to override the Scheduler Maximum Applications setting. The default setting is Inherited (no override).
    Maximum AM Resource
    This setting enables you to override the Scheduler Maximum AM Resource setting. The default setting is Inherited (no override).
    Priority
    An integer value that sets a relative priority for a queue. The default value is 0 for all queues. Setting this to a higher value gives a queue access to cluster resources ahead of queues with lower priorities. In order for YARN Queue Priorities to be applied, you must enable preemption. For more information see Setting YARN Queue Priorities.
    The following image shows the example Engineering queue with these settings specified: