org.apache.paimon.mergetree.compact

Class LookupMergeTreeCompactRewriter<T>

java.lang.Object

org.apache.paimon.mergetree.compact.AbstractCompactRewriter

org.apache.paimon.mergetree.compact.MergeTreeCompactRewriter

org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

org.apache.paimon.mergetree.compact.LookupMergeTreeCompactRewriter<T>

All Implemented Interfaces:

Closeable, AutoCloseable, CompactRewriter

public class LookupMergeTreeCompactRewriter<T>
extends ChangelogMergeTreeRewriter

A MergeTreeCompactRewriter which produces changelog files by lookup for the compaction involving level 0 files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LookupMergeTreeCompactRewriter.FirstRowMergeFunctionWrapperFactory A LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory for first row.
static class	LookupMergeTreeCompactRewriter.LookupMergeFunctionWrapperFactory<T> A normal LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory to create lookup wrapper.
static interface	LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory<T> Factory to create MergeFunctionWrapper.

Nested classes/interfaces inherited from class org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

ChangelogMergeTreeRewriter.UpgradeStrategy

Field Summary

Fields inherited from class org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

maxLevel, mergeEngine

Fields inherited from class org.apache.paimon.mergetree.compact.MergeTreeCompactRewriter

keyComparator, mergeSorter, mfFactory, readerFactory, userDefinedSeqComparator, writerFactory

Constructor Summary

Constructors

Constructor and Description

LookupMergeTreeCompactRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, LookupLevels<T> lookupLevels, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory<T> wrapperFactory, boolean produceChangelog, DeletionVectorsMaintainer dvMaintainer, CoreOptions options)

Method Summary

Modifier and Type	Method and Description
void	close()
protected MergeFunctionWrapper<ChangelogResult>	createMergeWrapper(int outputLevel)
protected void	notifyRewriteCompactBefore(List<DataFileMeta> files)
protected boolean	rewriteChangelog(int outputLevel, boolean dropDelete, List<List<SortedRun>> sections)
protected ChangelogMergeTreeRewriter.UpgradeStrategy	upgradeStrategy(int outputLevel, DataFileMeta file)

Methods inherited from class org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

rewrite, rewriteLookupChangelog, upgrade

Methods inherited from class org.apache.paimon.mergetree.compact.MergeTreeCompactRewriter

readerForMergeTree, rewriteCompaction

Methods inherited from class org.apache.paimon.mergetree.compact.AbstractCompactRewriter

extractFilesFromSections

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LookupMergeTreeCompactRewriter

public LookupMergeTreeCompactRewriter(int maxLevel,
                                      CoreOptions.MergeEngine mergeEngine,
                                      LookupLevels<T> lookupLevels,
                                      FileReaderFactory<KeyValue> readerFactory,
                                      KeyValueFileWriterFactory writerFactory,
                                      Comparator<InternalRow> keyComparator,
                                      @Nullable
                                      FieldsComparator userDefinedSeqComparator,
                                      MergeFunctionFactory<KeyValue> mfFactory,
                                      MergeSorter mergeSorter,
                                      LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory<T> wrapperFactory,
                                      boolean produceChangelog,
                                      @Nullable
                                      DeletionVectorsMaintainer dvMaintainer,
                                      CoreOptions options)

Method Detail

notifyRewriteCompactBefore

protected void notifyRewriteCompactBefore(List<DataFileMeta> files)

Overrides:

notifyRewriteCompactBefore in class MergeTreeCompactRewriter

rewriteChangelog

protected boolean rewriteChangelog(int outputLevel,
                                   boolean dropDelete,
                                   List<List<SortedRun>> sections)

Specified by:

rewriteChangelog in class ChangelogMergeTreeRewriter

upgradeStrategy

protected ChangelogMergeTreeRewriter.UpgradeStrategy upgradeStrategy(int outputLevel,
                                                                     DataFileMeta file)

Specified by:

upgradeStrategy in class ChangelogMergeTreeRewriter

createMergeWrapper

protected MergeFunctionWrapper<ChangelogResult> createMergeWrapper(int outputLevel)

Specified by:

createMergeWrapper in class ChangelogMergeTreeRewriter

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class AbstractCompactRewriter

Throws:

IOException