org.apache.paimon.operation

Class LocalOrphanFilesClean

java.lang.Object

org.apache.paimon.operation.OrphanFilesClean

org.apache.paimon.operation.LocalOrphanFilesClean

All Implemented Interfaces:

Serializable

public class LocalOrphanFilesClean
extends OrphanFilesClean

Local OrphanFilesClean, it will use thread pool to execute deletion.

Note that, this class will be used when the orphan clean mode is local, else orphan clean will use distributed one. See `FlinkOrphanFilesClean` and `SparkOrphanFilesClean`.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.operation.OrphanFilesClean

OrphanFilesClean.FileCleaner

Field Summary

Fields inherited from class org.apache.paimon.operation.OrphanFilesClean

fileIO, location, LOG, olderThanMillis, partitionKeysNum, READ_FILE_RETRY_INTERVAL, READ_FILE_RETRY_NUM, table

Constructor Summary

Constructors

Constructor and Description
LocalOrphanFilesClean(FileStoreTable table)
LocalOrphanFilesClean(FileStoreTable table, long olderThanMillis)
LocalOrphanFilesClean(FileStoreTable table, long olderThanMillis, boolean dryRun)

Method Summary

Modifier and Type	Method and Description
CleanOrphanFilesResult	clean()
static List<LocalOrphanFilesClean>	createOrphanFilesCleans(Catalog catalog, String databaseName, String tableName, long olderThanMillis, Integer parallelism, boolean dryRun)
static CleanOrphanFilesResult	executeDatabaseOrphanFiles(Catalog catalog, String databaseName, String tableName, long olderThanMillis, Integer parallelism, boolean dryRun)

Methods inherited from class org.apache.paimon.operation.OrphanFilesClean

cleanBranchSnapshotDir, cleanFile, cleanSnapshotDir, collectWithoutDataFile, collectWithoutDataFileWithManifestFlag, listPaimonFileDirs, listPaimonFileDirs, oldEnough, olderThanMillis, retryReadingFiles, safelyGetAllSnapshots, tryBestListingDirs, tryCleanDataDirectory, tryDeleteEmptyDirectory, validBranches

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalOrphanFilesClean

public LocalOrphanFilesClean(FileStoreTable table)

LocalOrphanFilesClean

public LocalOrphanFilesClean(FileStoreTable table,
                             long olderThanMillis)

LocalOrphanFilesClean

public LocalOrphanFilesClean(FileStoreTable table,
                             long olderThanMillis,
                             boolean dryRun)

Method Detail

clean

public CleanOrphanFilesResult clean()
                             throws IOException,
                                    ExecutionException,
                                    InterruptedException

Throws:

IOException

ExecutionException

InterruptedException

createOrphanFilesCleans

public static List<LocalOrphanFilesClean> createOrphanFilesCleans(Catalog catalog,
                                                                  String databaseName,
                                                                  @Nullable
                                                                  String tableName,
                                                                  long olderThanMillis,
                                                                  @Nullable
                                                                  Integer parallelism,
                                                                  boolean dryRun)
                                                           throws Catalog.DatabaseNotExistException,
                                                                  Catalog.TableNotExistException

Throws:

Catalog.DatabaseNotExistException

Catalog.TableNotExistException

executeDatabaseOrphanFiles

public static CleanOrphanFilesResult executeDatabaseOrphanFiles(Catalog catalog,
                                                                String databaseName,
                                                                @Nullable
                                                                String tableName,
                                                                long olderThanMillis,
                                                                @Nullable
                                                                Integer parallelism,
                                                                boolean dryRun)
                                                         throws Catalog.DatabaseNotExistException,
                                                                Catalog.TableNotExistException

Throws:

Catalog.DatabaseNotExistException

Catalog.TableNotExistException