ShuffleBlockResolver

2014-10-24 分类：spark-core 阅读(1281) 评论(0)

ShuffleBlockResolver is used to find shuffle block data.

Note	The one and only implementation of ShuffleBlockResolver contract in Spark is IndexShuffleBlockResolver.

Note	`ShuffleBlockResolver` is used exclusively in `BlockManager` to find shuffle block data.



trait ShuffleBlockResolver {
  def getBlockData(blockId: ShuffleBlockId): ManagedBuffer
  def stop(): Unit
}

trait ShuffleBlockResolver {

def getBlockData(blockId: ShuffleBlockId): ManagedBuffer

def stop(): Unit

}

Note	`ShuffleBlockResolver` is a `private[spark]` contract.

Table 1. ShuffleBlockResolver Contract
Method	Description
`getBlockData`	Used when `BlockManager` is requested to find shuffle block data and later (duplicate?) for local shuffle block data as serialized bytes.
`stop`	Used when `SortShuffleManager` stops.

赞(0) 打赏

关注公众号：spark技术分享