spark技术分享SupportsScanColumnarBatch
SupportsScanColumnarBatch is the contract…FIXME
|
1 2 3 4 5 6 7 8 9 10 11 |
package org.apache.spark.sql.sources.v2.reader; public interface SupportsScanColumnarBatch extends DataSourceReader { // only required methods that have no implementation // the others follow List<DataReaderFactory<ColumnarBatch>> createBatchDataReaderFactories(); } |
|
Note
|
In other words, using the contract is as treading on thin ice. |
| Method | Description |
|---|---|
|
Used when…FIXME |
|
Note
|
No custom SupportsScanColumnarBatch are part of Spark 2.3.
|
enableBatchRead Method
|
1 2 3 4 5 |
default boolean enableBatchRead() |
enableBatchRead flag is always enabled (i.e. true) unless overrode by custom SupportsScanColumnarBatches.
|
Note
|
enableBatchRead is used when…FIXME
|
