public abstract class ArrowBatchConverter extends Object
RecordReader.RecordIterator
into Arrow
format.Modifier and Type | Field and Description |
---|---|
protected ArrowFieldWriter[] |
fieldWriters |
protected RecordReader.RecordIterator<InternalRow> |
iterator |
protected org.apache.arrow.vector.VectorSchemaRoot |
root |
Modifier and Type | Method and Description |
---|---|
void |
close() |
protected abstract void |
doWrite(int maxBatchRows) |
org.apache.arrow.vector.VectorSchemaRoot |
next(int maxBatchRows)
Write and get at most
maxBatchRows data. |
protected void |
releaseIterator() |
protected final org.apache.arrow.vector.VectorSchemaRoot root
protected final ArrowFieldWriter[] fieldWriters
protected RecordReader.RecordIterator<InternalRow> iterator
@Nullable public org.apache.arrow.vector.VectorSchemaRoot next(int maxBatchRows)
maxBatchRows
data. Return null when finishing writing current
iterator.
NOTE: the returned value will be reused, and it's lifecycle is managed by this writer.
protected abstract void doWrite(int maxBatchRows)
public void close()
protected void releaseIterator()
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.