
Data Locality
Data locality / placement Spark relies on data locality, aka data placement or proximity to data source, that make ...

Data locality / placement Spark relies on data locality, aka data placement or proximity to data source, that make ...

HTTP File Server It is started on a driver. Caution FIXME Review HttpFileServer Settings spark.fil ...

ExecutorAllocationManagerSource — Metric Source for Dynamic Allocation

ExecutorAllocationListener Caution FIXME ExecutorAllocationListener is a SparkListener that intercepts e ...

ExecutorAllocationClient ExecutorAllocationClient is a contract for clients to communicate with a cluster manager ...

ExecutorAllocationManager — Allocation Manager for Spark Core

Dynamic Allocation (of Executors) Dynamic Allocation (of Executors) (aka Elastic Scaling) is a Spark feature that ...

CleanerListener Caution FIXME shuffleCleaned Callback Method Caution FIXME

ContextCleaner — Spark Application Garbage Collector

CompressionCodec With spark.broadcast.compress enabled (which is the default), TorrentBroadcast uses compression f ...