spark技术分享

2014-11-06admin阅读(1511)赞(0)

ExternalSorter ExternalSorter is a Spillable of WritablePartitionedPairCollection of K-key / C-value pairs. When ...

2014-11-05admin阅读(1718)赞(0)

ShuffleExternalSorter — Cache-Efficient Sorter

2014-11-04admin阅读(1947)赞(0)

ShuffleBlockFetcherIterator ShuffleBlockFetcherIterator is a Scala Iterator that fetches shuffle blocks (aka shuff ...

2014-11-03admin阅读(1545)赞(0)

BlockStoreShuffleReader BlockStoreShuffleReader is the one and only known ShuffleReader that reads the combined ke ...

2014-11-02admin阅读(1923)赞(0)

ShuffleReader ShuffleReader is a contract of shuffle readers to read combined key-value records for a reduce task. ...

2014-11-01admin阅读(1434)赞(0)

SerializedShuffleHandle — Marker Interface for Serialized Shuffle Handles

2014-10-31admin阅读(1561)赞(0)

BypassMergeSortShuffleHandle — Marker Interface for Bypass Merge Sort Shuffle Handles

2014-10-30admin阅读(1669)赞(0)

BaseShuffleHandle — Fallback Shuffle Handle

2014-10-29admin阅读(1540)赞(0)

UnsafeShuffleWriter — ShuffleWriter for SerializedShuffleHandle

2014-10-28admin阅读(3761)赞(0)

SortShuffleWriter — Fallback ShuffleWriter