spark技术分享FsHistoryProvider — File-System-Based History Provider
FsHistoryProvider is the default ApplicationHistoryProvider for Spark History Server.
FsHistoryProvider is created exclusively when HistoryServer is started as a standalone application and spark.history.provider configuration property was not defined.
|
Tip
|
Enable Add the following line to
Refer to Logging. |
rebuildAppStore Internal Method
|
1 2 3 4 5 6 7 8 |
rebuildAppStore( store: KVStore, eventLog: FileStatus, lastUpdated: Long): Unit |
rebuildAppStore…FIXME
|
Note
|
rebuildAppStore is used when…FIXME
|
getAppUI Method
|
1 2 3 4 5 |
getAppUI(appId: String, attemptId: Option[String]): Option[LoadedAppUI] |
|
Note
|
getAppUI is part of ApplicationHistoryProvider Contract to…FIXME.
|
getAppUI…FIXME
Creating FsHistoryProvider Instance
FsHistoryProvider takes the following when created:
FsHistoryProvider initializes the internal registries and counters.
