Inside Creating SparkContext
Inside Creating SparkContext This document describes what happens when you create a new SparkContext. [crayon-674 ...
Inside Creating SparkContext This document describes what happens when you create a new SparkContext. [crayon-674 ...
HeartbeatReceiver RPC Endpoint HeartbeatReceiver is a ThreadSafeRpcEndpoint registered on the driver under the nam ...
SparkContext — Entry Point to Spark Core
Deploy Mode Deploy mode specifies the location of where driver executes in the deployment environment. Deploy mo ...
Spark Properties and spark-defaults.conf Properties File
SparkConf — Spark Application’s Configuration
Anatomy of Spark Application Every Spark application starts from creating SparkContext. Note Without SparkC ...
Workers Workers (aka slaves) are running Spark instances where executors live to execute tasks. They are the compu ...
Master A master is a running Spark instance that connects to a cluster manager for resources. The master acquire ...
ExecutorSource ExecutorSource is a metrics source of an Executor. It uses an executor’s threadPool for calcu ...