org.apache.paimon.operation

Class ChangelogDeletion

java.lang.Object

org.apache.paimon.operation.FileDeletionBase<Changelog>

org.apache.paimon.operation.ChangelogDeletion

public class ChangelogDeletion
extends FileDeletionBase<Changelog>

Delete changelog files.

Field Summary

Fields inherited from class org.apache.paimon.operation.FileDeletionBase

changelogDecoupled, deletionBuckets, fileIO, indexFileHandler, manifestFile, manifestList, pathFactory, statsFileHandler

Constructor Summary

Constructors

Constructor and Description
ChangelogDeletion(FileIO fileIO, FileStorePathFactory pathFactory, ManifestFile manifestFile, ManifestList manifestList, IndexFileHandler indexFileHandler, StatsFileHandler statsFileHandler, boolean cleanEmptyDirectories, int deleteFileThreadNum)

Method Summary

Modifier and Type	Method and Description
void	cleanUnusedDataFiles(Changelog changelog, java.util.function.Predicate<ManifestEntry> skipper) Clean data files that will not be used anymore in the snapshot.
void	cleanUnusedManifests(Changelog changelog, Set<String> skippingSet) Clean metadata files that will not be used anymore of a snapshot, including data manifests, index manifests and manifest lists.
Set<String>	manifestSkippingSet(List<Snapshot> skippingSnapshots)

Methods inherited from class org.apache.paimon.operation.FileDeletionBase

addMergedDataFiles, cleanEmptyDirectories, cleanUnusedDataFiles, cleanUnusedIndexManifests, cleanUnusedManifestList, cleanUnusedManifests, cleanUnusedStatisticsManifests, containsDataFile, createDataFileSkipperForTags, deleteAddedDataFiles, deleteFiles, doCleanUnusedDataFile, getDataFileToDelete, manifestSkippingSet, readManifestFileNames, readMergedDataFiles, recordDeletionBuckets, setChangelogDecoupled, tryReadDataManifests, tryReadManifestList

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ChangelogDeletion

public ChangelogDeletion(FileIO fileIO,
                         FileStorePathFactory pathFactory,
                         ManifestFile manifestFile,
                         ManifestList manifestList,
                         IndexFileHandler indexFileHandler,
                         StatsFileHandler statsFileHandler,
                         boolean cleanEmptyDirectories,
                         int deleteFileThreadNum)

Method Detail

cleanUnusedDataFiles

public void cleanUnusedDataFiles(Changelog changelog,
                                 java.util.function.Predicate<ManifestEntry> skipper)

Description copied from class: FileDeletionBase

Clean data files that will not be used anymore in the snapshot.

Specified by:

cleanUnusedDataFiles in class FileDeletionBase<Changelog>

Parameters:

changelog - Snapshot that will be cleaned

skipper - if the test result of a data file is true, it will be skipped when deleting; else it will be deleted

cleanUnusedManifests

public void cleanUnusedManifests(Changelog changelog,
                                 Set<String> skippingSet)

Description copied from class: FileDeletionBase

Clean metadata files that will not be used anymore of a snapshot, including data manifests, index manifests and manifest lists.

Specified by:

cleanUnusedManifests in class FileDeletionBase<Changelog>

Parameters:

changelog - Snapshot that will be cleaned

skippingSet - manifests that should not be deleted

manifestSkippingSet

public Set<String> manifestSkippingSet(List<Snapshot> skippingSnapshots)

Overrides:

manifestSkippingSet in class FileDeletionBase<Changelog>