spark技术分享HistoryServerArguments
HistoryServerArguments is the command-line parser for the History Server.
When HistoryServerArguments is executed with a single command-line parameter it is assumed to be the event logs directory.
|
1 2 3 4 5 |
$ ./sbin/start-history-server.sh /tmp/spark-events |
This is however deprecated since Spark 1.1.0 and you should see the following WARN message in the logs:
|
1 2 3 4 5 |
WARN HistoryServerArguments: Setting log directory through the command line is deprecated as of Spark 1.1.0. Please set this through spark.history.fs.logDirectory instead. |
The same WARN message shows up for --dir and -d command-line options.
--properties-file [propertiesFile] command-line option specifies the file with the custom Spark properties.
|
Note
|
When not specified explicitly, History Server uses the default configuration file, i.e. spark-defaults.conf. |
|
Tip
|
Enable Add the following line to
Refer to Logging. |
