spark技术分享CollectionGenerator Generator Expression Contract
CollectionGenerator is the contract in Spark SQL for Generator expressions that generate a collection object (i.e. an array or map) and (at execution time) use a different path for whole-stage Java code generation (while executing GenerateExec physical operator with Whole-Stage Java Code Generation enabled).
|
1 2 3 4 5 6 7 8 9 10 11 |
package org.apache.spark.sql.catalyst.expressions trait CollectionGenerator extends Generator { def collectionType: DataType = dataType def inline: Boolean def position: Boolean } |
| Method | Description |
|---|---|
|
The type of the returned collection object. Used when… |
|
|
Flag whether to inline rows during whole-stage Java code generation. Used when… |
|
|
Flag whether to include the positions of elements within the result collection. Used when… |
| CollectionGenerator | Description |
|---|---|
