Jobs
ActiveJob A job (aka action job or active job) is a top-level work item (computation) submitted to DAGScheduler to ...
ActiveJob A job (aka action job or active job) is a top-level work item (computation) submitted to DAGScheduler to ...
DAGScheduler — Stage-Oriented Scheduler
SparkEnv — Spark Runtime Environment
MemoryManager Configuration Properties The page describes the memory-related configuration properties of Apache Sp ...
StaticMemoryManager — Legacy Memory Manager
UnifiedMemoryManager — Spark’s Memory Manager
MemoryManager — Memory Management System
SerializerManager Caution FIXME When SparkEnv is created (either for the driver or executors), it instan ...
AccumulatorContext AccumulatorContext is a private[spark] internal object used to track accumulators by Spark itse ...
Accumulators Accumulators are variables that are "added" to through an associative and commutative "add" operation ...