Package org.apache.paimon.mergetree.compact

Interface Summary

Interface	Description
CompactRewriter	Rewrite sections to new level.
CompactStrategy	Compact strategy to decide which files to select for compaction.
LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory<T>	Factory to create MergeFunctionWrapper.
MergeFunction<T>	Merge function to merge multiple KeyValues.
MergeFunctionFactory<T>	Factory to create MergeFunction.
MergeFunctionWrapper<T>	A wrapper for MergeFunction, which adds new functionalities or optimizations.
SortMergeReader<T>	This reader is to read a list of RecordReader, which is already sorted by key and sequence number, and perform a sort merge algorithm.

Class Summary

Class	Description
AbstractCompactRewriter	Common implementation of CompactRewriter.
ChangelogMergeTreeRewriter	A MergeTreeCompactRewriter which produces changelog files while performing compaction.
ChangelogResult	Changelog and final result for the same key.
ConcatRecordReader<T>	This reader is to concatenate a list of RecordReaders and read them sequentially.
DeduplicateMergeFunction	A MergeFunction where key is primary key (unique) and value is the full record, only keep the latest one.
FirstRowMergeFunction	A MergeFunction where key is primary key (unique) and value is the full record, only keep the first one.
FirstRowMergeFunctionWrapper	Wrapper for MergeFunctions to produce changelog by lookup for first row.
ForceUpLevel0Compaction	A CompactStrategy to force compacting level 0 files.
FullChangelogMergeFunctionWrapper	Wrapper for MergeFunctions to produce changelog during a full compaction.
FullChangelogMergeTreeCompactRewriter	A MergeTreeCompactRewriter which produces changelog files for each full compaction.
IntervalPartition	Algorithm to partition several data files into the minimum number of SortedRuns.
LookupChangelogMergeFunctionWrapper<T>	Wrapper for MergeFunctions to produce changelog by lookup during the compaction involving level 0 files.
LookupMergeFunction	A MergeFunction for lookup, this wrapper only considers the latest high level record, because each merge will query the old merged record, so the latest high level record should be the final merged value.
LookupMergeTreeCompactRewriter<T>	A MergeTreeCompactRewriter which produces changelog files by lookup for the compaction involving level 0 files.
LookupMergeTreeCompactRewriter.FirstRowMergeFunctionWrapperFactory	A LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory for first row.
LookupMergeTreeCompactRewriter.LookupMergeFunctionWrapperFactory<T>	A normal LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory to create lookup wrapper.
LoserTree<T>	A variant of the loser tree.
MergeFunctionFactory.AdjustedProjection	Result of adjusted projection.
MergeTreeCompactManager	Compact manager for KeyValueFileStore.
MergeTreeCompactRewriter	Default CompactRewriter for merge trees.
MergeTreeCompactTask	Compact task for merge tree compaction.
PartialUpdateMergeFunction	A MergeFunction where key is primary key (unique) and value is the partial record, update non-null fields on merge.
ReducerMergeFunctionWrapper	Wrapper for MergeFunctions which works like a reducer.
SortMergeReaderWithLoserTree<T>	SortMergeReader implemented with loser-tree.
SortMergeReaderWithMinHeap<T>	SortMergeReader implemented with min-heap.
UniversalCompaction	Universal Compaction Style is a compaction style, targeting the use cases requiring lower write amplification, trading off read amplification and space amplification.

Enum Summary

Enum	Description
ChangelogMergeTreeRewriter.UpgradeStrategy	Strategy for upgrade.