org.apache.paimon.mergetree.compact

Class FullChangelogMergeTreeCompactRewriter

java.lang.Object

org.apache.paimon.mergetree.compact.AbstractCompactRewriter

org.apache.paimon.mergetree.compact.MergeTreeCompactRewriter

org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

org.apache.paimon.mergetree.compact.FullChangelogMergeTreeCompactRewriter

All Implemented Interfaces:

Closeable, AutoCloseable, CompactRewriter

public class FullChangelogMergeTreeCompactRewriter
extends ChangelogMergeTreeRewriter

A MergeTreeCompactRewriter which produces changelog files for each full compaction.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

ChangelogMergeTreeRewriter.UpgradeStrategy

Field Summary

Fields inherited from class org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

maxLevel, mergeEngine

Fields inherited from class org.apache.paimon.mergetree.compact.MergeTreeCompactRewriter

keyComparator, mergeSorter, mfFactory, readerFactory, userDefinedSeqComparator, writerFactory

Constructor Summary

Constructors

Constructor and Description
FullChangelogMergeTreeCompactRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, RecordEqualiser valueEqualiser)

Method Summary

Modifier and Type	Method and Description
void	close()
protected MergeFunctionWrapper<ChangelogResult>	createMergeWrapper(int outputLevel)
protected boolean	rewriteChangelog(int outputLevel, boolean dropDelete, List<List<SortedRun>> sections)
protected ChangelogMergeTreeRewriter.UpgradeStrategy	upgradeStrategy(int outputLevel, DataFileMeta file)

Methods inherited from class org.apache.paimon.mergetree.compact.ChangelogMergeTreeRewriter

rewrite, rewriteLookupChangelog, upgrade

Methods inherited from class org.apache.paimon.mergetree.compact.MergeTreeCompactRewriter

notifyRewriteCompactBefore, readerForMergeTree, rewriteCompaction

Methods inherited from class org.apache.paimon.mergetree.compact.AbstractCompactRewriter

extractFilesFromSections

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FullChangelogMergeTreeCompactRewriter

public FullChangelogMergeTreeCompactRewriter(int maxLevel,
                                             CoreOptions.MergeEngine mergeEngine,
                                             FileReaderFactory<KeyValue> readerFactory,
                                             KeyValueFileWriterFactory writerFactory,
                                             Comparator<InternalRow> keyComparator,
                                             @Nullable
                                             FieldsComparator userDefinedSeqComparator,
                                             MergeFunctionFactory<KeyValue> mfFactory,
                                             MergeSorter mergeSorter,
                                             @Nullable
                                             RecordEqualiser valueEqualiser)

Method Detail

rewriteChangelog

protected boolean rewriteChangelog(int outputLevel,
                                   boolean dropDelete,
                                   List<List<SortedRun>> sections)

Specified by:

rewriteChangelog in class ChangelogMergeTreeRewriter

upgradeStrategy

protected ChangelogMergeTreeRewriter.UpgradeStrategy upgradeStrategy(int outputLevel,
                                                                     DataFileMeta file)

Specified by:

upgradeStrategy in class ChangelogMergeTreeRewriter

createMergeWrapper

protected MergeFunctionWrapper<ChangelogResult> createMergeWrapper(int outputLevel)

Specified by:

createMergeWrapper in class ChangelogMergeTreeRewriter

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class AbstractCompactRewriter

Throws:

IOException