spark-core 第26页

2014-07-21admin阅读(1390)赞(0)

Map/Reduce-side Aggregator Aggregator is a set of functions used to aggregate distributed data sets: [crayon-692e ...

2014-07-20admin阅读(1563)赞(0)

ShuffleDependency — Shuffle Dependency

2014-07-19admin阅读(1561)赞(0)

NarrowDependency — Narrow Dependencies

2014-07-18admin阅读(1601)赞(0)

RDD Dependencies Dependency class is the base (abstract) class to model a dependency relationship between two or m ...

2014-07-17admin阅读(870)赞(0)

CheckpointRDD Caution FIXME

2014-07-16admin阅读(1340)赞(0)

Checkpointing Checkpointing is a process of truncating RDD lineage graph and saving it to a reliable distributed ( ...

2014-07-15admin阅读(1608)赞(0)

RDD shuffling Tip Read the official documentation about the topic Shuffle operations. It is still better than ...

2014-07-14admin阅读(1597)赞(0)

HashPartitioner HashPartitioner is a Partitioner that uses partitions configurable number of partitions to shuffle ...

2014-07-13admin阅读(1558)赞(0)

Partitioner Caution FIXME Partitioner captures data distribution at the output. A scheduler can optimize ...

2014-07-12admin阅读(1545)赞(0)

Partition Partition is a contract of a partition index of a RDD. Note A partition is missing when it has no ...