StatefulOperatorStateInfo
StatefulOperatorStateInfo identifies the state store for a given operator:
StatefulOperatorStateInfo is created exclusively when IncrementalExecution is requested for nextStatefulOperationStateInfo.
When requested for a textual representation, StatefulOperatorStateInfo returns the following:
|
1 2 3 4 5 |
state info [ checkpoint = [checkpointLocation], runId = [queryRunId], opId = [operatorId], ver = [storeVersion], numPartitions = [numPartitions]] |
spark技术分享