Metrics Configuration Properties

spark.metrics.conf

metrics.properties

The metrics configuration file.

spark.metrics.namespace

Spark application’s ID (i.e. spark.app.id configuration property)

Root namespace for metrics reporting.

Since a Spark application’s ID changes with every execution of a Spark application, a custom spark.metrics.namespace can be specified for an easier metrics reporting.

Used when MetricsSystem is requested for a metrics source identifier (aka metrics namespace)