spark技术分享

2014-06-19admin阅读(1453)赞(0)

Inside Creating SparkContext This document describes what happens when you create a new SparkContext. [crayon-681 ...

2014-06-18admin阅读(1456)赞(0)

HeartbeatReceiver RPC Endpoint HeartbeatReceiver is a ThreadSafeRpcEndpoint registered on the driver under the nam ...

2014-06-17admin阅读(1484)赞(0)

SparkContext — Entry Point to Spark Core

2014-06-16admin阅读(1689)赞(0)

Deploy Mode Deploy mode specifies the location of where driver executes in the deployment environment. Deploy mo ...

2014-06-15admin阅读(1391)赞(0)

Spark Properties and spark-defaults.conf Properties File

2014-06-14admin阅读(1407)赞(0)

SparkConf — Spark Application’s Configuration

2014-06-13admin阅读(2786)赞(0)

Anatomy of Spark Application Every Spark application starts from creating SparkContext. Note Without SparkC ...

2014-06-12admin阅读(1116)赞(0)

Workers Workers (aka slaves) are running Spark instances where executors live to execute tasks. They are the compu ...

2014-06-11admin阅读(1399)赞(0)

Master A master is a running Spark instance that connects to a cluster manager for resources. The master acquire ...

2014-06-10admin阅读(1276)赞(0)

ExecutorSource ExecutorSource is a metrics source of an Executor. It uses an executor’s threadPool for calcu ...