spark技术分享PipelineStage — ML Pipeline Component
The PipelineStage abstract class represents a single stage in a Pipeline.
PipelineStage has the following direct implementations (of which few are abstract classes, too):
Each PipelineStage transforms schema using transformSchema family of methods:
|
1 2 3 4 5 6 |
transformSchema(schema: StructType): StructType transformSchema(schema: StructType, logging: Boolean): StructType |
|
Note
|
StructType describes a schema of a DataFrame. |
|
Tip
|
Enable |
