关注 spark技术分享,
撸spark源码 玩spark最佳实践

InputProcessor Helper Class of FlatMapGroupsWithStateExec Physical Operator

InputProcessor Helper Class of FlatMapGroupsWithStateExec Physical Operator

InputProcessor is a helper class to manage the state store of FlatMapGroupsWithStateExec physical operator.

InputProcessor is created exclusively when FlatMapGroupsWithStateExec physical operator is executed (and uses InputProcessor for the storeUpdateFunction while mapping over partitions with a state store).

InputProcessor takes a single StateStore when created.

processNewData Method

processNewData…​FIXME

Note
processNewData is used exclusively when FlatMapGroupsWithStateExec physical operator is executed.

processTimedOutState Method

processTimedOutState…​FIXME

Note
processTimedOutState is used exclusively when FlatMapGroupsWithStateExec physical operator is executed.

callFunctionAndUpdateState Internal Method

callFunctionAndUpdateState…​FIXME

Note
callFunctionAndUpdateState is used exclusively when InputProcessor is requested to processNewData and processTimedOutState.
赞(0) 打赏
未经允许不得转载:spark技术分享 » InputProcessor Helper Class of FlatMapGroupsWithStateExec Physical Operator
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏