Apache Hive Performance Tuning
Also available as:
PDF

Optimization and planning properties

The Ambari wizard automatically tunes the optimization- and planner-related configuration properties of Hive, Tez, and YARN, and you rarely need to make changes. However, in the event you want to tune these properties, guidelines are available.

Property Setting Guideline If Manual Configuration Is Needed Default Value in Ambari

hive.auto.convert.join.

noconditionaltask.size

one-third of -Xmx value Auto-tuned: Depends on environment
hive.tez.container.size

Production Systems: 4 to 8 GB

Small VMs: 1 to 2 GB

Auto-tuned: Depends on environment
hive.tez.java.opts -Xmx value must be 80% to 90% of container size Auto-tuned: Depends on environment
tez.grouping.min.size

Decrease for better latency

Increase for more throughput

16777216
tez.grouping.max.size

Decrease for better latency

Increase for more throughput

1073741824
tez.grouping.split-waves

Increase to launch more containers

Decrease to enhance multitenancy

1.7
yarn.scheduler.minimum-allocation-mb 1 GB is usually sufficient Auto-tuned: Depends on environment