org.apache.paimon.flink.compact

Class UnawareBucketCompactionTopoBuilder

java.lang.Object

org.apache.paimon.flink.compact.UnawareBucketCompactionTopoBuilder

public class UnawareBucketCompactionTopoBuilder
extends Object

Build for unaware-bucket table flink compaction job.

Note: This compaction job class is only used for unaware-bucket compaction, at start-up, it scans all the files from the latest snapshot, filter large file, and add small files into memory, generates compaction task for them. At continuous, it scans the delta files from the follow-up snapshot. We need to enable checkpoint for this compaction job, checkpoint will trigger committer stage to commit all the compacted files.

Constructor Summary

Constructors

Constructor and Description
UnawareBucketCompactionTopoBuilder(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String tableIdentifier, FileStoreTable table)

Method Summary

Modifier and Type	Method and Description
void	build()
void	withContinuousMode(boolean isContinuous)
void	withPartitionIdleTime(java.time.Duration partitionIdleTime)
void	withPartitionPredicate(Predicate predicate)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UnawareBucketCompactionTopoBuilder

public UnawareBucketCompactionTopoBuilder(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                          String tableIdentifier,
                                          FileStoreTable table)

Method Detail

withContinuousMode

public void withContinuousMode(boolean isContinuous)

withPartitionPredicate

public void withPartitionPredicate(Predicate predicate)

withPartitionIdleTime

public void withPartitionIdleTime(@Nullable
                                  java.time.Duration partitionIdleTime)

build

public void build()