KafkaOffsetRangeLimit

2012-05-12 分类：spark-sql 阅读(1261) 评论(0)

KafkaOffsetRangeLimit

KafkaOffsetRangeLimit is the desired offset range limits for starting, ending, and specific offsets.

Table 1. KafkaOffsetRangeLimits
KafkaOffsetRangeLimit	Description
`EarliestOffsetRangeLimit`	Bind to the earliest offset
`LatestOffsetRangeLimit`	Bind to the latest offset
`SpecificOffsetRangeLimit`	Bind to specific offsets Takes `partitionOffsets` (as `Map[TopicPartition, Long]`) when created.

KafkaOffsetRangeLimit is “created” (i.e. mapped to from a human-readable text representation) when KafkaSourceProvider is requested to getKafkaOffsetRangeLimit.

KafkaOffsetRangeLimit defines two constants to denote offset range limits that are resolved via Kafka: