Managing Data Operating System
Also available as:
PDF
loading table of contents...

Containerized Spark Configurations on YARN

You can use containerized Spark on YARN to run applications in two configuration modes: YARN client mode and YARN cluster mode.

In the YARN client mode, the Spark driver runs within the submission client’s JVM on gateway machines. The ApplicationMaster runs on the cluster separate from the driver.

In the YARN cluster mode, the Spark driver runs inside the YARN cluster alongside the ApplicationMaster.