spark技术分享

2014-06-09admin阅读(1897)赞(0)

TaskRunner TaskRunner is a thread of execution of a single task. TaskRunner is created exclusively when Executor ...

2014-06-08admin阅读(2111)赞(0)

Executor Executor is a distributed agent that is responsible for executing tasks. Executor is created when: ...

2014-06-07admin阅读(1667)赞(0)

Driver A Spark driver (aka an application’s driver process) is a JVM process that hosts SparkContext for a S ...

2014-06-06admin阅读(1019)赞(0)

Spark Architecture Spark uses a master/worker architecture. There is a driver that talks to a single coordinator c ...

2014-06-05admin阅读(1583)赞(0)

SparkLauncher — Launching Spark Applications Programmatically

2014-06-04admin阅读(1427)赞(0)

AbstractCommandBuilder AbstractCommandBuilder is the base command builder for SparkSubmitCommandBuilder and Spark ...

2014-06-03admin阅读(1586)赞(0)

spark-class shell script spark-class shell script is the Spark application command-line launcher that is responsib ...

2014-06-02admin阅读(1394)赞(0)

SparkSubmitCommandBuilder Command Builder

2014-06-01admin阅读(1579)赞(0)

SparkSubmitOptionParser — spark-submit’s Command-Line Parser

2014-05-31admin阅读(1152)赞(0)

SparkSubmitArguments — spark-submit’s Command-Line Argument Parser