spark技术分享BlockFetchingListener
BlockFetchingListener is the contract of EventListeners that want to be notified about onBlockFetchSuccess and onBlockFetchFailure.
BlockFetchingListener is used when:
-
ShuffleClient, BlockTransferService, NettyBlockTransferService, and ExternalShuffleClient are requested to fetch a sequence of blocks
-
BlockFetchStarteris requested to createAndStart -
RetryingBlockFetcher and
OneForOneBlockFetcherare created
|
1 2 3 4 5 6 7 8 9 10 |
package org.apache.spark.network.shuffle; interface BlockFetchingListener extends EventListener { void onBlockFetchSuccess(String blockId, ManagedBuffer data); void onBlockFetchFailure(String blockId, Throwable exception); } |
| Method | Description |
|---|---|
|
|
Used when…FIXME |
|
|
Used when…FIXME |
| BlockFetchingListener | Description |
|---|---|
|
“Unnamed” in ShuffleBlockFetcherIterator |
|
|
“Unnamed” in BlockTransferService |
