org.apache.paimon.operation

Class ManifestFileMerger

java.lang.Object

org.apache.paimon.operation.ManifestFileMerger

public class ManifestFileMerger
extends Object

Util for merging manifest files.

Constructor Summary

Constructors

Constructor and Description
ManifestFileMerger()

Method Summary

Modifier and Type	Method and Description
static List<ManifestFileMeta>	merge(List<ManifestFileMeta> input, ManifestFile manifestFile, long suggestedMetaSize, int suggestedMinMetaCount, long manifestFullCompactionSize, RowType partitionType, Integer manifestReadParallelism) Merge several ManifestFileMetas.
static Optional<List<ManifestFileMeta>>	tryFullCompaction(List<ManifestFileMeta> inputs, List<ManifestFileMeta> newFilesForAbort, ManifestFile manifestFile, long suggestedMetaSize, long sizeTrigger, RowType partitionType, Integer manifestReadParallelism)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ManifestFileMerger

public ManifestFileMerger()

Method Detail

merge

public static List<ManifestFileMeta> merge(List<ManifestFileMeta> input,
                                           ManifestFile manifestFile,
                                           long suggestedMetaSize,
                                           int suggestedMinMetaCount,
                                           long manifestFullCompactionSize,
                                           RowType partitionType,
                                           @Nullable
                                           Integer manifestReadParallelism)

Merge several ManifestFileMetas. ManifestEntrys representing first adding and then deleting the same data file will cancel each other.

NOTE: This method is atomic.

tryFullCompaction

public static Optional<List<ManifestFileMeta>> tryFullCompaction(List<ManifestFileMeta> inputs,
                                                                 List<ManifestFileMeta> newFilesForAbort,
                                                                 ManifestFile manifestFile,
                                                                 long suggestedMetaSize,
                                                                 long sizeTrigger,
                                                                 RowType partitionType,
                                                                 @Nullable
                                                                 Integer manifestReadParallelism)
                                                          throws Exception

Throws:

Exception