CatalogTablePartition — Partition Specification of Table-spark技术分享

CatalogTablePartition — Partition Specification of Table

CatalogTablePartition is the partition specification of a table, i.e. the metadata of the partitions of a table.

CatalogTablePartition is created when:

HiveClientImpl is requested to retrieve a table partition metadata
AlterTableAddPartitionCommand and AlterTableRecoverPartitionsCommand logical commands are executed

CatalogTablePartition can hold the table statistics that…FIXME

The readable text representation of a CatalogTablePartition (aka simpleString) is…FIXME

Note	`simpleString` is used exclusively when `ShowTablesCommand` is executed (with a partition specification).

CatalogTablePartition uses the following text representation (i.e. toString)…FIXME

Creating CatalogTablePartition Instance

CatalogTablePartition takes the following when created:

Partition specification
CatalogStorageFormat
Parameters (default: an empty collection)
Table statistics (default: None)

Converting Partition Specification to LinkedHashMap — `toLinkedHashMap` Method



toLinkedHashMap: mutable.LinkedHashMap[String, String]

toLinkedHashMap: mutable.LinkedHashMap[String, String]

toLinkedHashMap converts the partition specification to a collection of pairs (LinkedHashMap[String, String]) with the following fields and their values:

Partition Values with the spec
Storage specification (of the given CatalogStorageFormat)
Partition Parameters with the parameters (if not empty)
Partition Statistics with the CatalogStatistics (if available)

Note	`toLinkedHashMap` is used when: `DescribeTableCommand` logical command is executed (with the isExtended flag on and a non-empty partitionSpec). `CatalogTablePartition` is requested for either a simple or a catalog text representation

`location` Method



location: URI

location: URI

location simply returns the location URI of the CatalogStorageFormat or throws an AnalysisException:



Partition [[specString]] did not specify locationUri

Partition [[specString]] did not specify locationUri

Note	`location` is used when…FIXME

CatalogTablePartition — Partition Specification of Table