
Tasks
Task Task (aka command) is the smallest individual unit of execution that is launched to compute a RDD partition. ...
Task Task (aka command) is the smallest individual unit of execution that is launched to compute a RDD partition. ...
TaskScheduler — Spark Scheduler
JobWaiter [crayon-6802f2dc213b3532545897/] JobWaiter is a JobListener that is used when DAGScheduler submits a job ...
JobListener Spark subscribes for job completion or failure events (after submitting a job to DAGScheduler) using J ...
DAGSchedulerEventProcessLoop — DAGScheduler Event Bus
DAGSchedulerSource — Metrics Source for DAGScheduler
StageInfo Caution FIXME fromStage Method Caution FIXME
ResultStage — Final Stage in Job
ShuffleMapStage — Intermediate Stage in Execution DAG
Stage — Physical Unit Of Execution