Package | Description |
---|---|
org.apache.paimon.manifest | |
org.apache.paimon.operation | |
org.apache.paimon.table | |
org.apache.paimon.table.source.snapshot | |
org.apache.paimon.table.system |
Modifier and Type | Method and Description |
---|---|
ManifestFileMeta |
ManifestFileMetaSerializer.convertFrom(int version,
InternalRow row) |
ManifestFileMeta |
ManifestFileMeta.fromBytes(byte[] bytes) |
Modifier and Type | Method and Description |
---|---|
RollingFileWriter<ManifestEntry,ManifestFileMeta> |
ManifestFile.createRollingWriter() |
List<ManifestFileMeta> |
ManifestList.readAllManifests(Snapshot snapshot)
Return all
ManifestFileMeta instances for either data or changelog manifests in this
snapshot. |
List<ManifestFileMeta> |
ManifestList.readChangelogManifests(Snapshot snapshot)
Return a
ManifestFileMeta for each changelog manifest in this snapshot. |
List<ManifestFileMeta> |
ManifestList.readDataManifests(Snapshot snapshot)
Return a
ManifestFileMeta for each data manifest in this snapshot. |
List<ManifestFileMeta> |
ManifestList.readDeltaManifests(Snapshot snapshot)
Return a
ManifestFileMeta for each delta manifest in this snapshot. |
List<ManifestFileMeta> |
ManifestFile.write(List<ManifestEntry> entries)
Write several
ManifestEntry s into manifest files. |
Modifier and Type | Method and Description |
---|---|
InternalRow |
ManifestFileMetaSerializer.convertTo(ManifestFileMeta meta) |
Modifier and Type | Method and Description |
---|---|
static void |
FileEntry.mergeEntries(ManifestFile manifestFile,
List<ManifestFileMeta> manifestFiles,
Map<FileEntry.Identifier,ManifestEntry> map,
Integer manifestReadParallelism) |
static <T extends FileEntry> |
FileEntry.readDeletedEntries(java.util.function.Function<ManifestFileMeta,List<T>> manifestReader,
List<ManifestFileMeta> manifestFiles,
Integer manifestReadParallelism) |
static <T extends FileEntry> |
FileEntry.readDeletedEntries(java.util.function.Function<ManifestFileMeta,List<T>> manifestReader,
List<ManifestFileMeta> manifestFiles,
Integer manifestReadParallelism) |
static Set<FileEntry.Identifier> |
FileEntry.readDeletedEntries(ManifestFile manifestFile,
List<ManifestFileMeta> manifestFiles,
Integer manifestReadParallelism) |
static Iterable<ManifestEntry> |
FileEntry.readManifestEntries(ManifestFile manifestFile,
List<ManifestFileMeta> manifestFiles,
Integer manifestReadParallelism) |
String |
ManifestList.write(List<ManifestFileMeta> metas)
Write several
ManifestFileMeta s into a manifest list. |
Modifier and Type | Field and Description |
---|---|
List<ManifestFileMeta> |
ManifestsReader.Result.allManifests |
List<ManifestFileMeta> |
ManifestsReader.Result.filteredManifests |
Modifier and Type | Method and Description |
---|---|
static List<ManifestFileMeta> |
ManifestFileMerger.merge(List<ManifestFileMeta> input,
ManifestFile manifestFile,
long suggestedMetaSize,
int suggestedMinMetaCount,
long manifestFullCompactionSize,
RowType partitionType,
Integer manifestReadParallelism)
Merge several
ManifestFileMeta s. |
static Optional<List<ManifestFileMeta>> |
ManifestFileMerger.tryFullCompaction(List<ManifestFileMeta> inputs,
List<ManifestFileMeta> newFilesForAbort,
ManifestFile manifestFile,
long suggestedMetaSize,
long sizeTrigger,
RowType partitionType,
Integer manifestReadParallelism) |
protected List<ManifestFileMeta> |
FileDeletionBase.tryReadManifestList(String manifestListName)
It is possible that a job was killed during expiration and some manifest files have been
deleted, so if the clean methods need to get manifests of a snapshot to be cleaned, we should
try to read manifests and return empty list if failed instead of calling
ManifestList.readDataManifests(org.apache.paimon.Snapshot) directly. |
Modifier and Type | Method and Description |
---|---|
List<ManifestEntry> |
FileStoreScan.readManifest(ManifestFileMeta manifest) |
List<ManifestEntry> |
AbstractFileStoreScan.readManifest(ManifestFileMeta manifest)
Note: Keep this thread-safe.
|
Modifier and Type | Method and Description |
---|---|
static List<ManifestFileMeta> |
ManifestFileMerger.merge(List<ManifestFileMeta> input,
ManifestFile manifestFile,
long suggestedMetaSize,
int suggestedMinMetaCount,
long manifestFullCompactionSize,
RowType partitionType,
Integer manifestReadParallelism)
Merge several
ManifestFileMeta s. |
protected List<String> |
FileDeletionBase.readManifestFileNames(List<ManifestFileMeta> manifestFileMetas) |
static Optional<List<ManifestFileMeta>> |
ManifestFileMerger.tryFullCompaction(List<ManifestFileMeta> inputs,
List<ManifestFileMeta> newFilesForAbort,
ManifestFile manifestFile,
long suggestedMetaSize,
long sizeTrigger,
RowType partitionType,
Integer manifestReadParallelism) |
static Optional<List<ManifestFileMeta>> |
ManifestFileMerger.tryFullCompaction(List<ManifestFileMeta> inputs,
List<ManifestFileMeta> newFilesForAbort,
ManifestFile manifestFile,
long suggestedMetaSize,
long sizeTrigger,
RowType partitionType,
Integer manifestReadParallelism) |
Constructor and Description |
---|
Result(Snapshot snapshot,
List<ManifestFileMeta> allManifests,
List<ManifestFileMeta> filteredManifests) |
Result(Snapshot snapshot,
List<ManifestFileMeta> allManifests,
List<ManifestFileMeta> filteredManifests) |
Modifier and Type | Method and Description |
---|---|
SimpleFileReader<ManifestFileMeta> |
Table.manifestListReader()
Reader to read manifest file meta from manifest list file.
|
default SimpleFileReader<ManifestFileMeta> |
FormatTable.manifestListReader() |
default SimpleFileReader<ManifestFileMeta> |
ReadonlyTable.manifestListReader() |
SimpleFileReader<ManifestFileMeta> |
DelegatedFileStoreTable.manifestListReader() |
Modifier and Type | Method and Description |
---|---|
List<ManifestEntry> |
SnapshotReader.readManifest(ManifestFileMeta manifest) |
List<ManifestEntry> |
SnapshotReaderImpl.readManifest(ManifestFileMeta manifest) |
Modifier and Type | Method and Description |
---|---|
SimpleFileReader<ManifestFileMeta> |
FileMonitorTable.manifestListReader() |
SimpleFileReader<ManifestFileMeta> |
CompactBucketsTable.manifestListReader() |
SimpleFileReader<ManifestFileMeta> |
AuditLogTable.manifestListReader() |
SimpleFileReader<ManifestFileMeta> |
ReadOptimizedTable.manifestListReader() |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.