Apache Ambari Operations
Also available as:
PDF
loading table of contents...
Hive LLAP - Daemon

Metrics that show operating status for Hive LLAP Daemons.

RowMetrics

Description

Executor Metrics

Total Requests Submitted

Shows the total number of task requests handled by the daemon.

Total Requests Succeeded

Shows the total number of successful task requests handled by the daemon.
Total Requests FailedShows the total number of failed task requests handled by the daemon.
Total Requests KilledShows the total number of killed task requests handled by the daemon.
Total Requests Evicted From Wait QueueShows the total number of task requests handled by the daemon that were evicted from the wait queue. Tasks are evicted if all of the executor threads are in use by higher priority tasks.
Total Requests RejectedShows the total number of task requests handled by the daemon that were rejected by the task executor service. Task are rejected if all of the executor threads are in use and the wait queue is full of tasks that are not eligible for eviction.
Available Execution SlotsShows the total number of free slots that are available for execution including free executor threads and free slots in the wait queue.
95th Percentile Pre-emption Time Lost (300s interval)Shows the 95th percentile latencies for time lost due to pre-emption in 300 second intervals.
Max Pre-emption Time LostShows the maximum time lost due to pre-emption.
95th Percentile Time to Kill Pre-empted Task (300s interval)Shows the 95th percentile latencies for time taken to kill tasks due to pre-emption in 300 second intervals.
Max Time To Kill Task Pre-empted TaskShows the maximum time taken to kill a task due to pre-emption.

Cache Metrics

Total Cache Used

Shows the total amount of cache usage (Total, Remaining, and Used) in LLAP daemon cache.

Heap Usage

Shows the amount of memory remaining in LLAP daemon cache.
Average Cache Hit RateAs the data is released from the cache, the curve should increase. For example, the first query should run at 0, the second at 80-90 seconds, and then the third 10% faster. If, instead, it decreases, there might be a problem in the LLAP daemon.
Total Cache Read RequestsShows the total number of read requests received by LLAP daemon cache.

THREAD STATES

95th Percentile Column Decoding Time (30s interval)

Shows the 95th percentile latencies for time it takes to decode the column chunk (convert encoded column chunk to column vector batches for processing) in 30 second intervals. The cache comes from IO Elevator. It loads data from HDFS to the cache, and then from the cache to the executor. This metric shows how well the threads are performing and is useful to see that the threads are running.

Max Column Decoding Time

Shows the maximum time taken to decode column chunk (convert encoded column chunk to column vector batches for processing).