SchemaUtils Helper Object-spark技术分享

SchemaUtils Helper Object

SchemaUtils is a Scala object that is used for the following:

checkColumnNameDuplication
checkSchemaColumnNameDuplication

`checkColumnNameDuplication` Method



checkColumnNameDuplication(
  columnNames: Seq[String], colType: String, resolver: Resolver): Unit  (1)
checkColumnNameDuplication(
  columnNames: Seq[String], colType: String, caseSensitiveAnalysis: Boolean): Unit

checkColumnNameDuplication(

columnNames: Seq[String], colType: String, resolver: Resolver): Unit (1)

checkColumnNameDuplication(

columnNames: Seq[String], colType: String, caseSensitiveAnalysis: Boolean): Unit

Uses the other checkColumnNameDuplication with caseSensitiveAnalysis flag per isCaseSensitiveAnalysis

checkColumnNameDuplication…FIXME

Note	`checkColumnNameDuplication` is used when…FIXME

`checkSchemaColumnNameDuplication` Method



checkSchemaColumnNameDuplication(
  schema: StructType, colType: String, caseSensitiveAnalysis: Boolean = false): Unit

checkSchemaColumnNameDuplication(

schema: StructType, colType: String, caseSensitiveAnalysis: Boolean = false): Unit

checkSchemaColumnNameDuplication…FIXME

Note	`checkSchemaColumnNameDuplication` is used when…FIXME

`isCaseSensitiveAnalysis` Internal Method



isCaseSensitiveAnalysis(resolver: Resolver): Boolean

isCaseSensitiveAnalysis(resolver: Resolver): Boolean

isCaseSensitiveAnalysis…FIXME

Note	`isCaseSensitiveAnalysis` is used when…FIXME

SchemaUtils Helper Object