当前位置：spark技术分享 > spark-core > 正文

BlockStatusListener Spark Listener

2014-03-04 分类：spark-core 阅读(2333) 评论(0)

BlockStatusListener Spark Listener

BlockStatusListener is a SparkListener that tracks BlockManagers and the blocks for Storage tab in web UI.

Table 1. `BlockStatusListener` Registries
Registry	Description
`blockManagers`	The lookup table for a collection of BlockId and `BlockUIData` per BlockManagerId.

Caution

FIXME When are the events posted?

Table 2. `BlockStatusListener` Event Handlers
Event Handler	Description
`onBlockManagerAdded`	Registers a `BlockManager` in blockManagers internal registry (with no blocks).
`onBlockManagerRemoved`	Removes a `BlockManager` from blockManagers internal registry.
`onBlockUpdated`	Puts an updated `BlockUIData` for `BlockId` for `BlockManagerId` in blockManagers internal registry. Ignores updates for unregistered `BlockManager`s or non-`StreamBlockId`s. For invalid StorageLevels (i.e. they do not use a memory or a disk or no replication) the block is removed.

赞(0) 打赏

未经允许不得转载：spark技术分享 » BlockStatusListener Spark Listener

标签：spark-core

相关推荐

关注公众号：spark技术分享

联系我们联系我们

QQ咨询
QQ咨询
回顶
回顶部