org.apache.paimon.operation

Class SnapshotDeletion

java.lang.Object

org.apache.paimon.operation.FileDeletionBase<Snapshot>

org.apache.paimon.operation.SnapshotDeletion

public class SnapshotDeletion
extends FileDeletionBase<Snapshot>

Delete snapshot files.

Field Summary

Fields inherited from class org.apache.paimon.operation.FileDeletionBase

changelogDecoupled, deletionBuckets, fileIO, indexFileHandler, manifestFile, manifestList, pathFactory, statsFileHandler

Constructor Summary

Constructors

Constructor and Description
SnapshotDeletion(FileIO fileIO, FileStorePathFactory pathFactory, ManifestFile manifestFile, ManifestList manifestList, IndexFileHandler indexFileHandler, StatsFileHandler statsFileHandler, boolean produceChangelog, boolean cleanEmptyDirectories, int deleteFileThreadNum)

Method Summary

Modifier and Type	Method and Description
void	cleanUnusedDataFiles(Snapshot snapshot, java.util.function.Predicate<ManifestEntry> skipper) Clean data files that will not be used anymore in the snapshot.
void	cleanUnusedManifests(Snapshot snapshot, Set<String> skippingSet) Clean metadata files that will not be used anymore of a snapshot, including data manifests, index manifests and manifest lists.

Methods inherited from class org.apache.paimon.operation.FileDeletionBase

addMergedDataFiles, cleanEmptyDirectories, cleanUnusedDataFiles, cleanUnusedIndexManifests, cleanUnusedManifestList, cleanUnusedManifests, cleanUnusedStatisticsManifests, containsDataFile, createDataFileSkipperForTags, deleteAddedDataFiles, deleteFiles, doCleanUnusedDataFile, getDataFileToDelete, manifestSkippingSet, manifestSkippingSet, readManifestFileNames, readMergedDataFiles, recordDeletionBuckets, setChangelogDecoupled, tryReadDataManifests, tryReadManifestList

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SnapshotDeletion

public SnapshotDeletion(FileIO fileIO,
                        FileStorePathFactory pathFactory,
                        ManifestFile manifestFile,
                        ManifestList manifestList,
                        IndexFileHandler indexFileHandler,
                        StatsFileHandler statsFileHandler,
                        boolean produceChangelog,
                        boolean cleanEmptyDirectories,
                        int deleteFileThreadNum)

Method Detail

cleanUnusedDataFiles

public void cleanUnusedDataFiles(Snapshot snapshot,
                                 java.util.function.Predicate<ManifestEntry> skipper)

Description copied from class: FileDeletionBase

Clean data files that will not be used anymore in the snapshot.

Specified by:

cleanUnusedDataFiles in class FileDeletionBase<Snapshot>

Parameters:

snapshot - Snapshot that will be cleaned

skipper - if the test result of a data file is true, it will be skipped when deleting; else it will be deleted

cleanUnusedManifests

public void cleanUnusedManifests(Snapshot snapshot,
                                 Set<String> skippingSet)

Description copied from class: FileDeletionBase

Clean metadata files that will not be used anymore of a snapshot, including data manifests, index manifests and manifest lists.

Specified by:

cleanUnusedManifests in class FileDeletionBase<Snapshot>

Parameters:

snapshot - Snapshot that will be cleaned

skippingSet - manifests that should not be deleted