Kafka Data Source Options-spark技术分享

Kafka Data Source Options

Table 1. Kafka Data Source Options
Option	Default	Description
`assign`		One of the three subscription strategy options (with subscribe and subscribepattern) See KafkaSourceProvider.strategy
`endingoffsets`
`failondataloss`
`kafkaConsumer.pollTimeoutMs`		See kafkaConsumer.pollTimeoutMs
`startingoffsets`
`subscribe`		One of the three subscription strategy options (with subscribepattern and assign) See KafkaSourceProvider.strategy
`subscribepattern`		One of the three subscription strategy options (with subscribe and assign) See KafkaSourceProvider.strategy
`topic`		Required for writing a DataFrame to Kafka Used when: `KafkaSourceProvider` is requested to write a DataFrame to a Kafka topic and create a BaseRelation afterwards (Spark Structured Streaming) `KafkaSourceProvider` is requested to `createStreamWriter` and `createSink`