DataWriterFactory

2012-07-01 分类：spark-sql 阅读(2922) 评论(0)

DataWriterFactory

DataWriterFactory is a contract…FIXME



package org.apache.spark.sql.sources.v2.writer;

public interface DataWriterFactory<T> extends Serializable {
  DataWriter<T> createDataWriter(int partitionId, int attemptNumber);
}

package org.apache.spark.sql.sources.v2.writer;

public interface DataWriterFactory<T> extends Serializable {

DataWriter<T> createDataWriter(int partitionId, int attemptNumber);

}

Note	`DataWriterFactory` is an `Evolving` contract that is evolving towards becoming a stable API, but is not a stable API yet and can change from one feature release to another release. In other words, using the contract is as treading on thin ice.

Table 1. DataWriterFactory Contract
Method	Description
`createDataWriter`	Gives the DataWriter for a partition ID and attempt number Used when: `InternalRowDataWriterFactory` is requested to createDataWriter `DataWritingSparkTask` is requested to run and runContinuous