关注 spark技术分享,
撸spark源码 玩spark最佳实践

StreamingAggregationStateManagerImplV1 — Legacy State Manager for Streaming Aggregation

StreamingAggregationStateManagerImplV1 — Legacy State Manager for Streaming Aggregation

StreamingAggregationStateManagerImplV1 is the legacy state manager for streaming aggregations.

Note
The version of a state manager is controlled using spark.sql.streaming.aggregation.stateFormatVersion internal configuration property.

StreamingAggregationStateManagerImplV1 is created exclusively when StreamingAggregationStateManager is requested for a new StreamingAggregationStateManager.

Storing Row in State Store — put Method

Note
put is part of the StreamingAggregationStateManager Contract to store a row in a state store.

put…​FIXME

Creating StreamingAggregationStateManagerImplV1 Instance

StreamingAggregationStateManagerImplV1 takes the following when created:

  • Attribute expressions for keys (Seq[Attribute])

  • Attribute expressions of input rows (Seq[Attribute])

赞(0) 打赏
未经允许不得转载:spark技术分享 » StreamingAggregationStateManagerImplV1 — Legacy State Manager for Streaming Aggregation
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏