SparkStatusTracker
SparkStatusTracker SparkStatusTracker is…FIXME SparkStatusTracker is created when SparkContext is c ...
SparkStatusTracker SparkStatusTracker is…FIXME SparkStatusTracker is created when SparkContext is c ...
ConsoleProgressBar ConsoleProgressBar shows the progress of active stages to standard error, i.e. stderr. It uses ...
Inside Creating SparkContext This document describes what happens when you create a new SparkContext. [crayon-674 ...
HeartbeatReceiver RPC Endpoint HeartbeatReceiver is a ThreadSafeRpcEndpoint registered on the driver under the nam ...
SparkContext — Entry Point to Spark Core
Deploy Mode Deploy mode specifies the location of where driver executes in the deployment environment. Deploy mo ...
Spark Properties and spark-defaults.conf Properties File
SparkConf — Spark Application’s Configuration
Anatomy of Spark Application Every Spark application starts from creating SparkContext. Note Without SparkC ...
Workers Workers (aka slaves) are running Spark instances where executors live to execute tasks. They are the compu ...