spark技术分享CollapseWindow Logical Optimization
CollapseWindow is a base logical optimization that FIXME.
CollapseWindow is part of the Operator Optimization fixed-point batch in the standard batches of the Catalyst Optimizer.
CollapseWindow is simply a Catalyst rule for transforming logical plans, i.e. Rule[LogicalPlan].
|
1 2 3 4 5 6 7 8 9 |
// FIXME: DEMO import org.apache.spark.sql.catalyst.optimizer.CollapseWindow val logicalPlan = ??? val afterCollapseWindow = CollapseWindow(logicalPlan) |
Executing Rule — apply Method
|
1 2 3 4 5 |
apply(plan: LogicalPlan): LogicalPlan |
|
Note
|
apply is part of the Rule Contract to execute (apply) a rule on a TreeNode (e.g. LogicalPlan).
|
apply…FIXME
