TaskRunner
TaskRunner TaskRunner is a thread of execution of a single task. TaskRunner is created exclusively when Executor ...
TaskRunner TaskRunner is a thread of execution of a single task. TaskRunner is created exclusively when Executor ...
Executor Executor is a distributed agent that is responsible for executing tasks. Executor is created when: ...
Driver A Spark driver (aka an application’s driver process) is a JVM process that hosts SparkContext for a S ...
Spark Architecture Spark uses a master/worker architecture. There is a driver that talks to a single coordinator c ...
SparkLauncher — Launching Spark Applications Programmatically
AbstractCommandBuilder AbstractCommandBuilder is the base command builder for SparkSubmitCommandBuilder and Spark ...
spark-class shell script spark-class shell script is the Spark application command-line launcher that is responsib ...
SparkSubmitCommandBuilder Command Builder
SparkSubmitOptionParser — spark-submit’s Command-Line Parser
SparkSubmitArguments — spark-submit’s Command-Line Argument Parser