
Tasks
Task Task (aka command) is the smallest individual unit of execution that is launched to compute a RDD partition. ...

Task Task (aka command) is the smallest individual unit of execution that is launched to compute a RDD partition. ...

TaskScheduler — Spark Scheduler

JobWaiter [crayon-692e96ed2508a935219161/] JobWaiter is a JobListener that is used when DAGScheduler submits a job ...

JobListener Spark subscribes for job completion or failure events (after submitting a job to DAGScheduler) using J ...

DAGSchedulerEventProcessLoop — DAGScheduler Event Bus

DAGSchedulerSource — Metrics Source for DAGScheduler

StageInfo Caution FIXME fromStage Method Caution FIXME

ResultStage — Final Stage in Job

ShuffleMapStage — Intermediate Stage in Execution DAG

Stage — Physical Unit Of Execution