spark技术分享ExternalShuffleClient
ExternalShuffleClient is a ShuffleClient that…FIXME
Register Block Manager with Shuffle Server — registerWithShuffleServer Method
|
1 2 3 4 5 6 7 8 9 |
void registerWithShuffleServer( String host, int port, String execId, ExecutorShuffleInfo executorInfo) throws IOException, InterruptedException |
registerWithShuffleServer…FIXME
|
Note
|
registerWithShuffleServer is used when…FIXME
|
fetchBlocks Method
|
1 2 3 4 5 6 7 8 9 10 11 |
void fetchBlocks( String host, int port, String execId, String[] blockIds, BlockFetchingListener listener, TempFileManager tempFileManager) |
|
Note
|
fetchBlocks is part of ShuffleClient Contract to…FIXME.
|
fetchBlocks…FIXME
