public class FlinkOrphanFilesClean extends OrphanFilesClean
OrphanFilesClean
, it will submit a job for a table.OrphanFilesClean.ReaderWithIOException<T>
Modifier and Type | Field and Description |
---|---|
protected Integer |
parallelism |
fileCleaner, fileIO, location, LOG, olderThanMillis, partitionKeysNum, READ_FILE_RETRY_INTERVAL, READ_FILE_RETRY_NUM, table
Constructor and Description |
---|
FlinkOrphanFilesClean(FileStoreTable table,
long olderThanMillis,
SerializableConsumer<Path> fileCleaner,
Integer parallelism) |
Modifier and Type | Method and Description |
---|---|
org.apache.flink.streaming.api.datastream.DataStream<Long> |
doOrphanClean(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env) |
static long |
executeDatabaseOrphanFiles(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
Catalog catalog,
long olderThanMillis,
SerializableConsumer<Path> fileCleaner,
Integer parallelism,
String databaseName,
String tableName) |
cleanSnapshotDir, collectWithoutDataFile, collectWithoutDataFileWithManifestFlag, createFileCleaner, listPaimonFileDirs, oldEnough, olderThanMillis, retryReadingFiles, safelyGetAllSnapshots, tryBestListingDirs, validBranches
public FlinkOrphanFilesClean(FileStoreTable table, long olderThanMillis, SerializableConsumer<Path> fileCleaner, @Nullable Integer parallelism)
@Nullable public org.apache.flink.streaming.api.datastream.DataStream<Long> doOrphanClean(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
public static long executeDatabaseOrphanFiles(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, Catalog catalog, long olderThanMillis, SerializableConsumer<Path> fileCleaner, @Nullable Integer parallelism, String databaseName, @Nullable String tableName) throws Catalog.DatabaseNotExistException, Catalog.TableNotExistException
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.