spark技术分享

2014-12-16admin阅读(1850)赞(0)

YarnRMClient YarnRMClient is responsible for registering and unregistering a Spark application (in the form of App ...

2014-12-15admin阅读(1499)赞(0)

Client Client is a handle to a YARN cluster to submit ApplicationMaster (that represents a Spark application submi ...

2014-12-14admin阅读(1314)赞(0)

ExecutorRunnable ExecutorRunnable starts a YARN container with CoarseGrainedExecutorBackend standalone application ...

2014-12-13admin阅读(1302)赞(0)

YarnShuffleService — ExternalShuffleService on YARN

2014-12-12admin阅读(1643)赞(0)

Spark on YARN You can submit Spark applications to a Hadoop YARN cluster using yarn master URL. [crayon-68605a306 ...

2014-12-11admin阅读(1639)赞(0)

Spark Clustered Spark can be run in distributed mode on a cluster. The following (open source) cluster managers (a ...

2014-12-10admin阅读(1607)赞(0)

LocalEndpoint LocalEndpoint is the communication channel between Task Scheduler and LocalSchedulerBackend. It is a ...

2014-12-09admin阅读(3219)赞(0)

LocalSchedulerBackend LocalSchedulerBackend is a scheduler backend and a ExecutorBackend for Spark local run mode. ...

2014-12-08admin阅读(1455)赞(0)

Spark local (pseudo-cluster) You can run Spark in local mode. In this non-distributed single-JVM deployment mode, ...

2014-12-07admin阅读(1560)赞(0)

Deployment Environments — Run Modes