RuntimeConfig — Management Interface of Runtime Configuration-spark技术分享

RuntimeConfig — Management Interface of Runtime Configuration

RuntimeConfig is the management interface of the runtime configuration.

Method Description



get(key: String): String
get(key: String, default: String): String

get(key: String): String

get(key: String, default: String): String

getAll



getAll: Map[String, String]

getAll: Map[String, String]

getOption



getOption(key: String): Option[String]

getOption(key: String): Option[String]

isModifiable



isModifiable(key: String): Boolean

isModifiable(key: String): Boolean

(New in 2.4.0)

set



set(key: String, value: Boolean): Unit
set(key: String, value: Long): Unit
set(key: String, value: String): Unit

set(key: String, value: Boolean): Unit

set(key: String, value: Long): Unit

set(key: String, value: String): Unit

unset



unset(key: String): Unit

unset(key: String): Unit

RuntimeConfig is available using the conf attribute of a SparkSession.



scala> :type spark
org.apache.spark.sql.SparkSession

scala> :type spark.conf
org.apache.spark.sql.RuntimeConfig

scala> :type spark

org.apache.spark.sql.SparkSession

scala> :type spark.conf

org.apache.spark.sql.RuntimeConfig

Figure 1. RuntimeConfig, SparkSession and SQLConf

RuntimeConfig is created exclusively when SparkSession is requested for one.

RuntimeConfig takes a SQLConf when created.

`get` Method



get(key: String): String
get(key: String, default: String): String

get(key: String): String

get(key: String, default: String): String

get…FIXME

Note	`get` is used when…FIXME

`getAll` Method



getAll: Map[String, String]

getAll: Map[String, String]

getAll…FIXME

Note	`getAll` is used when…FIXME

`getOption` Method



getOption(key: String): Option[String]

getOption(key: String): Option[String]

getOption…FIXME

Note	`getOption` is used when…FIXME

`set` Method



set(key: String, value: Boolean): Unit
set(key: String, value: Long): Unit
set(key: String, value: String): Unit

set(key: String, value: Boolean): Unit

set(key: String, value: Long): Unit

set(key: String, value: String): Unit

set…FIXME

Note	`set` is used when…FIXME

`unset` Method



unset(key: String): Unit

unset(key: String): Unit

unset…FIXME

Note	`unset` is used when…FIXME

RuntimeConfig — Management Interface of Runtime Configuration