关注 spark技术分享,
撸spark源码 玩spark最佳实践

web UI Configuration Properties

web UI Configuration Properties

Table 1. web UI Configuration Properties
Name Default Value Description

spark.ui.allowFramingFrom

Defines the URL to use in ALLOW-FROM in X-Frame-Options header (as described in http://tools.ietf.org/html/rfc7034).

Used exclusively when JettyUtils is requested to create an HttpServlet.

spark.ui.consoleProgress.update.interval

200 (ms)

Update interval, i.e. how often to show the progress.

spark.ui.enabled

true

The flag to control whether the web UI is started (true) or not (false).

spark.ui.port

4040

The port web UI binds to.

If multiple SparkContexts attempt to run on the same host (it is not possible to have two or more Spark contexts on a single JVM, though), they will bind to successive ports beginning with spark.ui.port.

spark.ui.killEnabled

true

Enables jobs and stages to be killed from the web UI (true) or not (false).

Used exclusively when SparkUI is requested to initialize (and registers the redirect handlers for /jobs/job/kill and /stages/stage/kill URIs)

spark.ui.retainedDeadExecutors

100

The maximum number of entries in executorToTaskSummary (in ExecutorsListener) and deadExecutorStorageStatus (in StorageStatusListener) internal registries.

spark.ui.showConsoleProgress

true

Controls whether to create ConsoleProgressBar (true) or not (false).

spark.ui.timeline.executors.maximum

1000

The maximum number of entries in executorEvents registry.

spark.ui.timeline.tasks.maximum

1000

赞(0) 打赏
未经允许不得转载:spark技术分享 » web UI Configuration Properties
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏