Spark Guide
Also available as:
PDF
loading table of contents...

(Optional) Configuring the Spark History Server

The Spark History Server is a monitoring tool that lists information about completed Spark applications. Applications write history data to a directory on HDFS (recommended) or ATS. The History Server pulls the data and presents it in a Web UI at <host>:18080 (by default).

For information about configuring optional History Server properties, see the Apache Monitoring and Instrumentation document.

For Kerberos considerations, see Configuring Spark for a Kerberos-Enabled Cluster.