spark技术分享

2015-08-20admin阅读(1473)赞(0)

FileStreamSink — Streaming Sink for Parquet Format

2015-08-19admin阅读(1297)赞(0)

FileStreamSource FileStreamSource is a Source that reads text files from path directory as they appear. It uses Lo ...

2015-08-18admin阅读(1372)赞(0)

TextSocketSource TextSocketSource is a streaming source that reads lines from a socket at the host and port (defin ...

2015-08-17admin阅读(1844)赞(0)

TextSocketSourceProvider TextSocketSourceProvider is a StreamSourceProvider for TextSocketSource that read records ...

2015-08-16admin阅读(1368)赞(0)

KafkaSink KafkaSink is a streaming sink that KafkaSourceProvider registers as the kafka format. [crayon-676857c95 ...

2015-08-15admin阅读(1138)赞(0)

KafkaSourceOffset KafkaSourceOffset is a OffsetV2 that…​FIXME KafkaSourceOffset takes a collection o ...

2015-08-14admin阅读(1384)赞(0)

ConsumerStrategy Contract for KafkaConsumer Providers

2015-08-13admin阅读(1264)赞(0)

KafkaOffsetReader KafkaOffsetReader is created when: KafkaRelation builds an RDD with rows that are records fr ...

2015-08-12admin阅读(1232)赞(0)

CachedKafkaConsumer Caution FIXME poll Internal Method Caution FIXME fetchData Internal Me ...

2015-08-11admin阅读(1111)赞(0)

KafkaSourceRDD KafkaSourceRDD is an RDD of Kafka’s ConsumerRecords (with keys and values being collections o ...