
Jobs
ActiveJob A job (aka action job or active job) is a top-level work item (computation) submitted to DAGScheduler to ...

ActiveJob A job (aka action job or active job) is a top-level work item (computation) submitted to DAGScheduler to ...

DAGScheduler — Stage-Oriented Scheduler

SparkEnv — Spark Runtime Environment

MemoryManager Configuration Properties The page describes the memory-related configuration properties of Apache Sp ...

StaticMemoryManager — Legacy Memory Manager

UnifiedMemoryManager — Spark’s Memory Manager

MemoryManager — Memory Management System

SerializerManager Caution FIXME When SparkEnv is created (either for the driver or executors), it instan ...

AccumulatorContext AccumulatorContext is a private[spark] internal object used to track accumulators by Spark itse ...

Accumulators Accumulators are variables that are "added" to through an associative and commutative "add" operation ...