
TaskRunner
TaskRunner TaskRunner is a thread of execution of a single task. TaskRunner is created exclusively when Executor ...

TaskRunner TaskRunner is a thread of execution of a single task. TaskRunner is created exclusively when Executor ...

Executor Executor is a distributed agent that is responsible for executing tasks. Executor is created when: ...

Driver A Spark driver (aka an application’s driver process) is a JVM process that hosts SparkContext for a S ...

Spark Architecture Spark uses a master/worker architecture. There is a driver that talks to a single coordinator c ...

SparkLauncher — Launching Spark Applications Programmatically

AbstractCommandBuilder AbstractCommandBuilder is the base command builder for SparkSubmitCommandBuilder and Spark ...

spark-class shell script spark-class shell script is the Spark application command-line launcher that is responsib ...

SparkSubmitCommandBuilder Command Builder

SparkSubmitOptionParser — spark-submit’s Command-Line Parser

SparkSubmitArguments — spark-submit’s Command-Line Argument Parser