Configure a YARN queue for workload management
You must add a custom YARN queue for workload management if you enable workload
management; otherwise, it is likely that workload management will not start. This queue is
in addition to the LLAP queue, named
llap by default that is also required
for interactive querying and workload management.
llap queue capacity is reserved for launching LLAP daemons and
pre-provisioned YARN Application Masters (AMs), which correspond to Maximum Total
Concurrent Queries that you configure during LLAP setup. Typically, the entire
llap queue is used when LLAP daemons and AMs are running. There
is insufficient capacity for workload management to use the same llap queue because
workload management requires more AMs/sessions. Configuring an interactive YARN
queue for workload management solves this problem.
- Total cluster capacity = 100 GB
llapqueue capacity = 50 GB
- Workload management queue capacity = 20 GB
In Ambari, select Services > YARN > Configs, and from the hamburger menu Views (top right), select YARN Queue Manager.
Click Add Queue, and enter a queue path (name)
wm, for example. Click .
Configure the capacity of the
wmqueue to greater than zero.
Make adjustments in the capacity and max capacity of other queues as necessary
to resolve the error. For example, adjust the default queue from 50 percent to
wmqueue under Add Queue, and in Resources that appears on the right, set
User Limit Factorto 1, and set
Priorityto greater than 0 (1 for example).
- Select and Refresh Queues.
- In restart any YARN services as prompted.
- In Ambari, navigate to Services > Hive > Configs > Advanced > Custom hiveserver2-interactive-site.
Add the following property and set its value to the name of the workload
wm, for example: Key:
- Save the configuration.