spark技术分享StorageMemoryPool
StorageMemoryPool is a MemoryPool that…FIXME
StorageMemoryPool is created along with MemoryManager (as onHeapStorageMemoryPool and offHeapStorageMemoryPool pools).
| Name | Description |
|---|---|
|
|
Used when…FIXME |
|
|
The amount of memory in use for storage (caching) Used when…FIXME |
|
|
Used when…FIXME |
acquireMemory Method
|
1 2 3 4 5 6 7 8 9 |
acquireMemory(blockId: BlockId, numBytes: Long): Boolean (1) acquireMemory( blockId: BlockId, numBytesToAcquire: Long, numBytesToFree: Long): Boolean |
-
Calls
acquireMemorywithnumBytesToFreeas a difference betweennumBytesand memoryFree
acquireMemory…FIXME
|
Note
|
|
freeSpaceToShrinkPool Method
|
1 2 3 4 5 |
freeSpaceToShrinkPool(spaceToFree: Long): Long |
freeSpaceToShrinkPool…FIXME
|
Note
|
freeSpaceToShrinkPool is used exclusively when UnifiedMemoryManager is requested to acquireExecutionMemory.
|
Creating StorageMemoryPool Instance
StorageMemoryPool takes the following when created:
StorageMemoryPool initializes the internal registries and counters.
