spark技术分享StreamingAggregationStateManagerBaseImpl — Base State Manager for Streaming Aggregation
StreamingAggregationStateManagerBaseImpl is the base implementation of the StreamingAggregationStateManager contract for state managers for streaming aggregations that use UnsafeProjection to getKey.
StreamingAggregationStateManagerBaseImpl uses UnsafeProjection to getKey.
| StreamingAggregationStateManagerBaseImpl | Description |
|---|---|
|
Current StreamingAggregationStateManager |
Creating StreamingAggregationStateManagerBaseImpl Instance
StreamingAggregationStateManagerBaseImpl takes the following when created:
|
Note
|
StreamingAggregationStateManagerBaseImpl is a Scala abstract class and cannot be created directly. It is created indirectly for the concrete StreamingAggregationStateManagerBaseImpls.
|
Committing (Changes to) State Store — commit Method
|
1 2 3 4 5 |
commit(store: StateStore): Long |
|
Note
|
commit is part of the StreamingAggregationStateManager Contract to commit changes to a state store.
|
commit simply requests the state store to commit state changes.
Removing Key From State Store — remove Method
|
1 2 3 4 5 |
remove(store: StateStore, key: UnsafeRow): Unit |
|
Note
|
remove is part of the StreamingAggregationStateManager Contract to remove a key from a state store.
|
remove…FIXME
getKey Method
|
1 2 3 4 5 |
getKey(row: UnsafeRow): UnsafeRow |
|
Note
|
getKey is part of the StreamingAggregationStateManager Contract to…FIXME
|
getKey…FIXME
Getting All Keys in State Store — keys Method
|
1 2 3 4 5 |
keys(store: StateStore): Iterator[UnsafeRow] |
|
Note
|
keys is part of the StreamingAggregationStateManager Contract to get all keys in a state store (as an iterator).
|
keys…FIXME
