spark技术分享Deploy Mode
Deploy mode specifies the location of where driver executes in the deployment environment.
Deploy mode can be one of the following options:
-
client(default) – the driver runs on the machine that the Spark application was launched. -
cluster– the driver runs on a random node in a cluster.
|
Note
|
cluster deploy mode is only available for non-local cluster deployments.
|
You can control the deploy mode of a Spark application using spark-submit’s --deploy-mode command-line option or spark.submit.deployMode Spark property.
|
Note
|
spark.submit.deployMode setting can be client or cluster.
|
Client Deploy Mode
|
Caution
|
FIXME |
Cluster Deploy Mode
|
Caution
|
FIXME |
