spark技术分享

2014-11-26admin阅读(1454)赞(0)

Data locality / placement Spark relies on data locality, aka data placement or proximity to data source, that make ...

2014-11-25admin阅读(1374)赞(0)

HTTP File Server It is started on a driver. Caution FIXME Review HttpFileServer Settings spark.fil ...

2014-11-24admin阅读(1500)赞(0)

ExecutorAllocationManagerSource — Metric Source for Dynamic Allocation

2014-11-23admin阅读(1374)赞(0)

ExecutorAllocationListener Caution FIXME ExecutorAllocationListener is a SparkListener that intercepts e ...

2014-11-22admin阅读(1452)赞(0)

ExecutorAllocationClient ExecutorAllocationClient is a contract for clients to communicate with a cluster manager ...

2014-11-21admin阅读(1592)赞(0)

ExecutorAllocationManager — Allocation Manager for Spark Core

2014-11-20admin阅读(1944)赞(0)

Dynamic Allocation (of Executors) Dynamic Allocation (of Executors) (aka Elastic Scaling) is a Spark feature that ...

2014-11-19admin阅读(3315)赞(0)

CleanerListener Caution FIXME shuffleCleaned Callback Method Caution FIXME

2014-11-18admin阅读(3914)赞(0)

ContextCleaner — Spark Application Garbage Collector

2014-11-17admin阅读(2548)赞(0)

CompressionCodec With spark.broadcast.compress enabled (which is the default), TorrentBroadcast uses compression f ...