spark技术分享UnspecifiedDistribution
UnspecifiedDistribution is a Distribution that…FIXME
UnspecifiedDistribution specifies None for the required number of partitions.
|
Note
|
None for the required number of partitions indicates to use any number of partitions (possibly spark.sql.shuffle.partitions configuration property with the default of 200 partitions).
|
createPartitioning Method
|
1 2 3 4 5 |
createPartitioning(numPartitions: Int): Partitioning |
|
Note
|
createPartitioning is part of Distribution Contract to create a Partitioning for a given number of partitions.
|
createPartitioning…FIXME
