As the number of concurrent users increases, you should generally keep the number of queues to a minimum and instead increase the number of sessions in each queue. For example, for 5-10 concurrent users, 2-5 queues with 1-2 sessions each might be adequate. To set 3 queues with 2 sessions for each queue:
hive.server2.tez.default.queues=hive1,hive2,hive3 hive.server2.tez.sessions.per.default.queue=2
If the number of concurrent users increases to 15, you may achieve better performance using 5 queues with 3 sessions per queue:
hive.server2.tez.default.queues=hive1,hive2,hive3,hive4,hive5 hive.server2.tez.sessions.per.default.queue=3
The following table provides general guidelines for the number of queues and sessions for increasing numbers of concurrent users.
Table 1.1. Queues and Sessions for Increasing Numbers of Concurrent Users
| Number of Users | Number of Concurrent Users | Number of Queues | Number of Sessions per Queue |
|---|---|---|---|
| 50 | 5 | 2-5 | 1-2 |
| 100 | 10 | 5 | 2 |
| 150 | 15 | 5 | 3 |
| 200 | 20 | 5 | 4 |
