DataSourceRDDPartition

2012-06-28 分类：spark-sql 阅读(1263) 评论(0)

DataSourceRDDPartition is a Spark Core Partition of DataSourceRDD and Spark Structured Streaming’s ContinuousDataSourceRDD RDDs.

DataSourceRDDPartition is created when:

DataSourceRDD and Spark Structured Streaming’s ContinuousDataSourceRDD are requested for partitions
DataSourceRDD and Spark Structured Streaming’s ContinuousDataSourceRDD are requested to compute a partition
DataSourceRDD and Spark Structured Streaming’s ContinuousDataSourceRDD are requested for preferred locations