Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
IndexBootstrap.bootstrap(int numAssigners,
int assignId) |
Modifier and Type | Class and Description |
---|---|
class |
ApplyDeletionVectorReader
A
RecordReader which apply DeletionVector to filter record. |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
ApplyDeletionVectorReader.reader() |
Constructor and Description |
---|
ApplyDeletionVectorReader(RecordReader<InternalRow> reader,
DeletionVector deletionVector) |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
CompactedChangelogFormatReaderFactory.createReader(FormatReaderFactory.Context context) |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
IncrementalCompactDiffSplitRead.createReader(DataSplit split) |
RecordReader<InternalRow> |
LookupStreamingReader.nextBatch(boolean useParallelism) |
RecordReader<InternalRow> |
LookupCompactDiffRead.reader(Split split) |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
FormatReaderFactory.createReader(FormatReaderFactory.Context context) |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
AvroBulkFormat.createReader(FormatReaderFactory.Context context) |
Modifier and Type | Class and Description |
---|---|
class |
FileRecordReader
Reads
InternalRow from data files. |
class |
KeyValueDataFileRecordReader
RecordReader for reading KeyValue data files. |
Modifier and Type | Method and Description |
---|---|
RecordReader<KeyValue> |
KeyValueFileReaderFactory.createRecordReader(DataFileMeta file) |
RecordReader<T> |
FileReaderFactory.createRecordReader(DataFileMeta file) |
RecordReader<KeyValue> |
KeyValueFileReaderFactory.createRecordReader(long schemaId,
String fileName,
long fileSize,
int level) |
static RecordReader<InternalRow> |
SplitsParallelReadUtil.parallelExecute(RowType projectedType,
FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
List<Split> splits,
int pageSize,
int parallelism) |
static <EXTRA> RecordReader<InternalRow> |
SplitsParallelReadUtil.parallelExecute(RowType projectedType,
FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
List<Split> splits,
int pageSize,
int parallelism,
java.util.function.Function<Split,EXTRA> extraFunction,
java.util.function.BiFunction<InternalRow,EXTRA,InternalRow> addExtraToRow) |
Modifier and Type | Method and Description |
---|---|
static RecordReader<InternalRow> |
SplitsParallelReadUtil.parallelExecute(RowType projectedType,
FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
List<Split> splits,
int pageSize,
int parallelism) |
static <EXTRA> RecordReader<InternalRow> |
SplitsParallelReadUtil.parallelExecute(RowType projectedType,
FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
List<Split> splits,
int pageSize,
int parallelism,
java.util.function.Function<Split,EXTRA> extraFunction,
java.util.function.BiFunction<InternalRow,EXTRA,InternalRow> addExtraToRow) |
Constructor and Description |
---|
KeyValueDataFileRecordReader(RecordReader<InternalRow> reader,
RowType keyType,
RowType valueType,
int level) |
Modifier and Type | Class and Description |
---|---|
class |
DropDeleteReader
|
Modifier and Type | Method and Description |
---|---|
<T> RecordReader<T> |
MergeSorter.mergeSort(List<SizedReaderSupplier<KeyValue>> lazyReaders,
Comparator<InternalRow> keyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunction) |
<T> RecordReader<T> |
MergeSorter.mergeSortNoSpill(List<? extends ReaderSupplier<KeyValue>> lazyReaders,
Comparator<InternalRow> keyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunction) |
static <T> RecordReader<T> |
MergeTreeReaders.readerForMergeTree(List<List<SortedRun>> sections,
FileReaderFactory<KeyValue> readerFactory,
Comparator<InternalRow> userKeyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunctionWrapper,
MergeSorter mergeSorter) |
static <T> RecordReader<T> |
MergeTreeReaders.readerForSection(List<SortedRun> section,
FileReaderFactory<KeyValue> readerFactory,
Comparator<InternalRow> userKeyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunctionWrapper,
MergeSorter mergeSorter) |
Constructor and Description |
---|
DropDeleteReader(RecordReader<KeyValue> reader) |
Constructor and Description |
---|
LookupLevels(Levels levels,
Comparator<InternalRow> keyComparator,
RowType keyType,
LookupLevels.ValueProcessor<T> valueProcessor,
IOFunction<DataFileMeta,RecordReader<KeyValue>> fileReaderFactory,
java.util.function.Function<String,File> localFileFactory,
LookupStoreFactory lookupStoreFactory,
java.util.function.Function<Long,BloomFilter.Builder> bfGenerator,
org.apache.paimon.shade.caffeine2.com.github.benmanes.caffeine.cache.Cache<String,LookupFile> lookupFileCache) |
Modifier and Type | Interface and Description |
---|---|
interface |
SortMergeReader<T>
This reader is to read a list of
RecordReader , which is already sorted by key and
sequence number, and perform a sort merge algorithm. |
Modifier and Type | Class and Description |
---|---|
class |
ConcatRecordReader<T>
This reader is to concatenate a list of
RecordReader s and read them sequentially. |
class |
SortMergeReaderWithLoserTree<T>
SortMergeReader implemented with loser-tree. |
class |
SortMergeReaderWithMinHeap<T>
SortMergeReader implemented with min-heap. |
Modifier and Type | Method and Description |
---|---|
static <R> RecordReader<R> |
ConcatRecordReader.create(List<? extends ReaderSupplier<R>> readers) |
static <R> RecordReader<R> |
ConcatRecordReader.create(ReaderSupplier<R> reader1,
ReaderSupplier<R> reader2) |
protected <T> RecordReader<T> |
MergeTreeCompactRewriter.readerForMergeTree(List<List<SortedRun>> sections,
MergeFunctionWrapper<T> mergeFunctionWrapper) |
Modifier and Type | Method and Description |
---|---|
static <T> SortMergeReader<T> |
SortMergeReader.createSortMergeReader(List<RecordReader<KeyValue>> readers,
Comparator<InternalRow> userKeyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunctionWrapper,
CoreOptions.SortEngine sortEngine) |
Constructor and Description |
---|
LoserTree(List<RecordReader<T>> nextBatchReaders,
Comparator<T> firstComparator,
Comparator<T> secondComparator) |
SortMergeReaderWithLoserTree(List<RecordReader<KeyValue>> readers,
Comparator<InternalRow> userKeyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunctionWrapper) |
SortMergeReaderWithMinHeap(List<RecordReader<KeyValue>> readers,
Comparator<InternalRow> userKeyComparator,
FieldsComparator userDefinedSeqComparator,
MergeFunctionWrapper<T> mergeFunctionWrapper) |
Modifier and Type | Class and Description |
---|---|
class |
ReverseReader
A
RecordReader which reverses the RowKind of the KeyValue from RowKind.INSERT to RowKind.DELETE read from the wrapped reader. |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
DefaultValueAssigner.assignFieldsDefaultValue(RecordReader<InternalRow> reader)
assign default value for column which value is null.
|
RecordReader<KeyValue> |
MergeFileSplitRead.createMergeReader(BinaryRow partition,
int bucket,
List<DataFileMeta> files,
List<DeletionFile> deletionFiles,
boolean keepDelete) |
RecordReader<KeyValue> |
MergeFileSplitRead.createNoMergeReader(BinaryRow partition,
int bucket,
List<DataFileMeta> files,
List<DeletionFile> deletionFiles,
boolean onlyFilterKey) |
RecordReader<InternalRow> |
RawFileSplitRead.createReader(BinaryRow partition,
int bucket,
List<DataFileMeta> files,
List<IOExceptionSupplier<DeletionVector>> dvFactories) |
RecordReader<InternalRow> |
RawFileSplitRead.createReader(DataSplit split) |
RecordReader<KeyValue> |
MergeFileSplitRead.createReader(DataSplit split) |
RecordReader<T> |
SplitRead.createReader(DataSplit split)
Create a
RecordReader from split. |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
DefaultValueAssigner.assignFieldsDefaultValue(RecordReader<InternalRow> reader)
assign default value for column which value is null.
|
Modifier and Type | Method and Description |
---|---|
static <L,R> SplitRead<R> |
SplitRead.convert(SplitRead<L> read,
IOFunction<DataSplit,RecordReader<R>> convertedFactory) |
Constructor and Description |
---|
ReverseReader(RecordReader<KeyValue> reader) |
Modifier and Type | Class and Description |
---|---|
class |
EmptyRecordReader<T>
An empty
RecordReader . |
Modifier and Type | Method and Description |
---|---|
default RecordReader<T> |
RecordReader.filter(Filter<T> filter)
Filters a
RecordReader . |
RecordReader<T> |
ReaderSupplier.get() |
default <R> RecordReader<R> |
RecordReader.transform(java.util.function.Function<T,R> function)
Returns a
RecordReader that applies function to each element. |
Constructor and Description |
---|
RecordReaderIterator(RecordReader<T> reader) |
Modifier and Type | Method and Description |
---|---|
default RecordReader<InternalRow> |
TableRead.createReader(List<Split> splits) |
RecordReader<InternalRow> |
TableRead.createReader(Split split) |
RecordReader<InternalRow> |
AbstractDataTableRead.createReader(Split split) |
default RecordReader<InternalRow> |
TableRead.createReader(TableScan.Plan plan) |
RecordReader<InternalRow> |
KeyValueTableRead.reader(Split split) |
abstract RecordReader<InternalRow> |
AbstractDataTableRead.reader(Split split) |
static RecordReader<InternalRow> |
KeyValueTableRead.unwrap(RecordReader<KeyValue> reader) |
Modifier and Type | Method and Description |
---|---|
static RecordReader<InternalRow> |
KeyValueTableRead.unwrap(RecordReader<KeyValue> reader) |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
IncrementalDiffSplitRead.createReader(DataSplit split) |
Modifier and Type | Method and Description |
---|---|
RecordReader<InternalRow> |
TableLineageTable.TableLineageRead.createReader(Split split) |
Modifier and Type | Class and Description |
---|---|
class |
AsyncRecordReader<T>
A
RecordReader to use ASYNC_EXECUTOR to read records async. |
class |
IteratorRecordReader<T>
Wrap a
Iterator as an RecordReader . |
Modifier and Type | Method and Description |
---|---|
static RecordReader<InternalRow> |
FileUtils.createFormatReader(FileIO fileIO,
FormatReaderFactory format,
Path file,
Long fileSize) |
Constructor and Description |
---|
AsyncRecordReader(IOExceptionSupplier<RecordReader<T>> supplier) |
ParallelExecution(Serializer<T> serializer,
int pageSize,
int parallelism,
List<java.util.function.Supplier<Pair<RecordReader<T>,E>>> readers) |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.