spark技术分享ApplicationHistoryProvider
ApplicationHistoryProvider is the base of the history providers of Spark applications.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
package org.apache.spark.deploy.history abstract class ApplicationHistoryProvider { // only required methods that have no implementation // the others follow def getListing(): Iterator[ApplicationInfo] def getAppUI(appId: String, attemptId: Option[String]): Option[LoadedAppUI] def writeEventLogs(appId: String, attemptId: Option[String], zipStream: ZipOutputStream): Unit def getApplicationInfo(appId: String): Option[ApplicationInfo] } |
|
Note
|
ApplicationHistoryProvider is a private[history] contract.
|
| Method | Description |
|---|---|
|
|
|
|
|
SparkUI (the UI of a Spark application) Used exclusively when |
|
|
|
|
|
ApplicationHistoryProvider is a Scala abstract class and cannot be created directly, but only as one of the implementations.
|
Note
|
FsHistoryProvider is the one and only known implementation of ApplicationHistoryProvider contract in Apache Spark. |
