SQLAppStatusListener Spark Listener-spark技术分享

SQLAppStatusListener Spark Listener

SQLAppStatusListener is a SparkListener that…FIXME

Table 1. SQLAppStatusListener’s Internal Properties (e.g. Registries, Counters and Flags)
Name	Description
`liveUpdatePeriodNs`
`liveExecutions`
`stageMetrics`
`uiInitialized`

`onExecutionStart` Internal Method



onExecutionStart(event: SparkListenerSQLExecutionStart): Unit

onExecutionStart(event: SparkListenerSQLExecutionStart): Unit

onExecutionStart…FIXME

Note	`onExecutionStart` is used exclusively when `SQLAppStatusListener` handles a SparkListenerSQLExecutionStart event.

`onJobStart` Callback



onJobStart(event: SparkListenerJobStart): Unit

onJobStart(event: SparkListenerJobStart): Unit

Note	`onJobStart` is part of SparkListener Contract to…FIXME

onJobStart…FIXME

`onStageSubmitted` Callback



onStageSubmitted(event: SparkListenerStageSubmitted): Unit

onStageSubmitted(event: SparkListenerStageSubmitted): Unit

Note	`onStageSubmitted` is part of SparkListener Contract to…FIXME

onStageSubmitted…FIXME

`onJobEnd` Callback



onJobEnd(event: SparkListenerJobEnd): Unit

onJobEnd(event: SparkListenerJobEnd): Unit

Note	`onJobEnd` is part of SparkListener Contract to…FIXME

onJobEnd…FIXME

`onExecutorMetricsUpdate` Callback



onExecutorMetricsUpdate(event: SparkListenerExecutorMetricsUpdate): Unit

onExecutorMetricsUpdate(event: SparkListenerExecutorMetricsUpdate): Unit

Note	`onExecutorMetricsUpdate` is part of SparkListener Contract to…FIXME

onExecutorMetricsUpdate…FIXME

`onTaskEnd` Callback



onTaskEnd(event: SparkListenerTaskEnd): Unit

onTaskEnd(event: SparkListenerTaskEnd): Unit

Note	`onTaskEnd` is part of SparkListener Contract to…FIXME

onTaskEnd…FIXME

Handling SparkListenerEvent — `onOtherEvent` Callback



onOtherEvent(event: SparkListenerEvent): Unit

onOtherEvent(event: SparkListenerEvent): Unit

Note	`onOtherEvent` is part of SparkListener Contract to…FIXME

onOtherEvent…FIXME

SQLAppStatusListener Spark Listener