关注 spark技术分享,
撸spark源码 玩spark最佳实践

SerializedShuffleHandle — Marker Interface for Serialized Shuffle Handles

SerializedShuffleHandle — Marker Interface for Serialized Shuffle Handles

SerializedShuffleHandle is a BaseShuffleHandle with no additional methods or fields and serves only to identify the choice of a serialized shuffle.

Like BaseShuffleHandle, SerializedShuffleHandle takes shuffleId, numMaps, and a ShuffleDependency.

SerializedShuffleHandle is created when SortShuffleManager is requested for a ShuffleHandle (for a ShuffleDependency) and the conditions hold (but for BypassMergeSortShuffleHandle do not which are checked first).

赞(0) 打赏
未经允许不得转载:spark技术分享 » SerializedShuffleHandle — Marker Interface for Serialized Shuffle Handles
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏