public class DataFileRecordReader extends Object implements FileRecordReader<InternalRow>
InternalRow
from data files.RecordReader.RecordIterator<T>
Constructor and Description |
---|
DataFileRecordReader(FormatReaderFactory readerFactory,
FormatReaderFactory.Context context,
int[] indexMapping,
CastFieldGetter[] castMapping,
PartitionInfo partitionInfo) |
Modifier and Type | Method and Description |
---|---|
void |
close()
Closes the reader and should release all resources.
|
FileRecordIterator<InternalRow> |
readBatch()
Reads one batch.
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
filter, forEachRemaining, forEachRemainingWithPosition, toCloseableIterator, transform
public DataFileRecordReader(FormatReaderFactory readerFactory, FormatReaderFactory.Context context, @Nullable int[] indexMapping, @Nullable CastFieldGetter[] castMapping, @Nullable PartitionInfo partitionInfo) throws IOException
IOException
@Nullable public FileRecordIterator<InternalRow> readBatch() throws IOException
RecordReader
The returned iterator object and any contained objects may be held onto by the source for some time, so it should not be immediately reused by the reader.
readBatch
in interface FileRecordReader<InternalRow>
readBatch
in interface RecordReader<InternalRow>
IOException
public void close() throws IOException
RecordReader
close
in interface Closeable
close
in interface AutoCloseable
close
in interface RecordReader<InternalRow>
IOException
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.