关注 spark技术分享,
撸spark源码 玩spark最佳实践

DataReaderFactory

DataReaderFactory

DataReaderFactory is a contract…​FIXME

Note

DataReaderFactory is an Evolving contract that is evolving towards becoming a stable API, but is not a stable API yet and can change from one feature release to another release.

In other words, using the contract is as treading on thin ice.

Table 1. DataReaderFactory Contract
Method Description

createDataReader

Used when…​FIXME

Specifying Preferred Locations —  preferredLocations Method

preferredLocations defaults to an empty collection of host names (as the preferred locations) which simply means that this task has no location preference.

Note

preferredLocations is used when:

  • DataSourceRDD is requested for getPreferredLocations

  • RowToUnsafeRowDataReaderFactory is requested for preferredLocations

  • Spark Structured Streaming’s ContinuousDataSourceRDD is requested for getPreferredLocations

赞(0) 打赏
未经允许不得转载:spark技术分享 » DataReaderFactory
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏