关注 spark技术分享,
撸spark源码 玩spark最佳实践

EventTimeStatsAccum Accumulator

EventTimeStatsAccum Accumulator

EventTimeStatsAccum is a Spark accumulator of EventTimeStats from Longs (i.e. AccumulatorV2[Long, EventTimeStats]) that collects statistics on event time in a streaming batch.

EventTimeStatsAccum takes a EventTimeStats when created.

EventTimeStatsAccum is used exclusively when EventTimeWatermarkExec is executed (and accumulates eventTime values from every row in a streaming batch).

赞(0) 打赏
未经允许不得转载:spark技术分享 » EventTimeStatsAccum Accumulator
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏