spark技术分享CatalystSerde Helper Object
CatalystSerde is a Scala object that consists of three utility methods:
-
deserialize to create a new logical plan with the input logical plan wrapped inside DeserializeToObject logical operator.
CatalystSerde and belongs to org.apache.spark.sql.catalyst.plans.logical package.
Creating Logical Plan with DeserializeToObject Logical Operator for Logical Plan — deserialize Method
|
1 2 3 4 5 |
deserialize[T : Encoder](child: LogicalPlan): DeserializeToObject |
deserialize creates a DeserializeToObject logical operator for the input child logical plan.
Internally, deserialize creates a UnresolvedDeserializer for the deserializer for the type T first and passes it on to a DeserializeToObject with a AttributeReference (being the result of generateObjAttr).
