Master
Master A master is a running Spark instance that connects to a cluster manager for resources. The master acquire ...
Master A master is a running Spark instance that connects to a cluster manager for resources. The master acquire ...
ExecutorSource ExecutorSource is a metrics source of an Executor. It uses an executor’s threadPool for calcu ...
TaskRunner TaskRunner is a thread of execution of a single task. TaskRunner is created exclusively when Executor ...
Executor Executor is a distributed agent that is responsible for executing tasks. Executor is created when: ...
Driver A Spark driver (aka an application’s driver process) is a JVM process that hosts SparkContext for a S ...
Spark Architecture Spark uses a master/worker architecture. There is a driver that talks to a single coordinator c ...
SparkLauncher — Launching Spark Applications Programmatically
AbstractCommandBuilder AbstractCommandBuilder is the base command builder for SparkSubmitCommandBuilder and Spark ...
spark-class shell script spark-class shell script is the Spark application command-line launcher that is responsib ...
SparkSubmitCommandBuilder Command Builder