org.apache.paimon.mergetree.compact

Class MergeTreeCompactManager

java.lang.Object

org.apache.paimon.compact.CompactFutureManager

org.apache.paimon.mergetree.compact.MergeTreeCompactManager

All Implemented Interfaces:

Closeable, AutoCloseable, CompactManager

public class MergeTreeCompactManager
extends CompactFutureManager

Compact manager for KeyValueFileStore.

Field Summary

Fields inherited from class org.apache.paimon.compact.CompactFutureManager

taskFuture

Constructor Summary

Constructors

Constructor and Description
MergeTreeCompactManager(ExecutorService executor, Levels levels, CompactStrategy strategy, Comparator<InternalRow> keyComparator, long compactionFileSize, int numSortedRunStopTrigger, CompactRewriter rewriter, CompactionMetrics.Reporter metricsReporter, DeletionVectorsMaintainer dvMaintainer, boolean lazyGenDeletionFile, boolean needLookup, RecordLevelExpire recordLevelExpire)

Method Summary

Modifier and Type	Method and Description
void	addNewFile(DataFileMeta file) Add a new file.
List<DataFileMeta>	allFiles()
void	close()
boolean	compactNotCompleted() Check if a compaction is in progress, or if a compaction result remains to be fetched, or if a compaction should be triggered later.
Optional<CompactResult>	getCompactionResult(boolean blocking) Finish current task, and update result files to Levels.
CompactStrategy	getStrategy()
Levels	levels()
boolean	shouldWaitForLatestCompaction() Should wait compaction finish.
boolean	shouldWaitForPreparingCheckpoint()
void	triggerCompaction(boolean fullCompaction) Trigger a new compaction task.

Methods inherited from class org.apache.paimon.compact.CompactFutureManager

cancelCompaction, innerGetCompactionResult, obtainCompactResult

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MergeTreeCompactManager

public MergeTreeCompactManager(ExecutorService executor,
                               Levels levels,
                               CompactStrategy strategy,
                               Comparator<InternalRow> keyComparator,
                               long compactionFileSize,
                               int numSortedRunStopTrigger,
                               CompactRewriter rewriter,
                               @Nullable
                               CompactionMetrics.Reporter metricsReporter,
                               @Nullable
                               DeletionVectorsMaintainer dvMaintainer,
                               boolean lazyGenDeletionFile,
                               boolean needLookup,
                               @Nullable
                               RecordLevelExpire recordLevelExpire)

Method Detail

shouldWaitForLatestCompaction

public boolean shouldWaitForLatestCompaction()

Description copied from interface: CompactManager

Should wait compaction finish.

shouldWaitForPreparingCheckpoint

public boolean shouldWaitForPreparingCheckpoint()

addNewFile

public void addNewFile(DataFileMeta file)

Description copied from interface: CompactManager

Add a new file.

allFiles

public List<DataFileMeta> allFiles()

triggerCompaction

public void triggerCompaction(boolean fullCompaction)

Description copied from interface: CompactManager

Trigger a new compaction task.

Parameters:

fullCompaction - if caller needs a guaranteed full compaction

levels

@VisibleForTesting
public Levels levels()

getCompactionResult

public Optional<CompactResult> getCompactionResult(boolean blocking)
                                            throws ExecutionException,
                                                   InterruptedException

Finish current task, and update result files to Levels.

Throws:

ExecutionException

InterruptedException

compactNotCompleted

public boolean compactNotCompleted()

Description copied from interface: CompactManager

Check if a compaction is in progress, or if a compaction result remains to be fetched, or if a compaction should be triggered later.

Specified by:

compactNotCompleted in interface CompactManager

Overrides:

compactNotCompleted in class CompactFutureManager

close

public void close()
           throws IOException

Throws:

IOException

getStrategy

@VisibleForTesting
public CompactStrategy getStrategy()