Managing Data Operating System
Also available as:
PDF
loading table of contents...

Examples of Running Spark Jobs with Docker Containers

You can use Docker containers on YARN to run Spark applications coded with the help of packages such as PySpark and SparkR such that the required binaries and other software dependencies run on the Docker containers.