spark技术分享

2014-07-19admin阅读(1483)赞(0)

NarrowDependency — Narrow Dependencies

2014-07-18admin阅读(1523)赞(0)

RDD Dependencies Dependency class is the base (abstract) class to model a dependency relationship between two or m ...

2014-07-17admin阅读(820)赞(0)

CheckpointRDD Caution FIXME

2014-07-16admin阅读(1251)赞(0)

Checkpointing Checkpointing is a process of truncating RDD lineage graph and saving it to a reliable distributed ( ...

2014-07-15admin阅读(1493)赞(0)

RDD shuffling Tip Read the official documentation about the topic Shuffle operations. It is still better than ...

2014-07-14admin阅读(1514)赞(0)

HashPartitioner HashPartitioner is a Partitioner that uses partitions configurable number of partitions to shuffle ...

2014-07-13admin阅读(1480)赞(0)

Partitioner Caution FIXME Partitioner captures data distribution at the output. A scheduler can optimize ...

2014-07-12admin阅读(1470)赞(0)

Partition Partition is a contract of a partition index of a RDD. Note A partition is missing when it has no ...

2014-07-11admin阅读(1514)赞(0)

Partitions and Partitioning Introduction Depending on how you look at Spark (programmer, devop, admin), an RDD is ...

2014-07-10admin阅读(1553)赞(0)

StorageLevel StorageLevel describes how an RDD is persisted (and addresses the following concerns): Does RDD u ...