
YarnRMClient
YarnRMClient YarnRMClient is responsible for registering and unregistering a Spark application (in the form of App ...

YarnRMClient YarnRMClient is responsible for registering and unregistering a Spark application (in the form of App ...

Client Client is a handle to a YARN cluster to submit ApplicationMaster (that represents a Spark application submi ...

ExecutorRunnable ExecutorRunnable starts a YARN container with CoarseGrainedExecutorBackend standalone application ...

YarnShuffleService — ExternalShuffleService on YARN

Spark on YARN You can submit Spark applications to a Hadoop YARN cluster using yarn master URL. [crayon-69268860e ...

Spark Clustered Spark can be run in distributed mode on a cluster. The following (open source) cluster managers (a ...

LocalEndpoint LocalEndpoint is the communication channel between Task Scheduler and LocalSchedulerBackend. It is a ...

LocalSchedulerBackend LocalSchedulerBackend is a scheduler backend and a ExecutorBackend for Spark local run mode. ...

Spark local (pseudo-cluster) You can run Spark in local mode. In this non-distributed single-JVM deployment mode, ...

Deployment Environments — Run Modes