org.apache.paimon.mergetree.compact

Interface SortMergeReader<T>

All Superinterfaces:

AutoCloseable, Closeable, RecordReader<T>

All Known Implementing Classes:

SortMergeReaderWithLoserTree, SortMergeReaderWithMinHeap

public interface SortMergeReader<T>
extends RecordReader<T>

This reader is to read a list of RecordReader, which is already sorted by key and sequence number, and perform a sort merge algorithm. KeyValues with the same key will also be combined during sort merging.

NOTE: KeyValues from the same RecordReader must not contain the same key.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.paimon.reader.RecordReader

RecordReader.RecordIterator<T>

Method Summary

Modifier and Type	Method and Description
static <T> SortMergeReader<T>	createSortMergeReader(List<RecordReader<KeyValue>> readers, Comparator<InternalRow> userKeyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunctionWrapper, CoreOptions.SortEngine sortEngine)

Methods inherited from interface org.apache.paimon.reader.RecordReader

close, filter, forEachRemaining, forEachRemainingWithPosition, readBatch, toCloseableIterator, transform

Method Detail

createSortMergeReader

static <T> SortMergeReader<T> createSortMergeReader(List<RecordReader<KeyValue>> readers,
                                                    Comparator<InternalRow> userKeyComparator,
                                                    @Nullable
                                                    FieldsComparator userDefinedSeqComparator,
                                                    MergeFunctionWrapper<T> mergeFunctionWrapper,
                                                    CoreOptions.SortEngine sortEngine)