spark技术分享HasParallelism
HasParallelism is a Scala trait for Spark MLlib components that allow for specifying the level of parallelism for multi-threaded execution and provide a thread-pool-based execution context.
HasParallelism defines parallelism parameter that controls the number of threads in a cached thread pool.
| Parameter | Default Value | Description |
|---|---|---|
|
|
The number of threads to use when running parallel algorithms Must be at least |
