Package | Description |
---|---|
org.apache.paimon.append | |
org.apache.paimon.compact | |
org.apache.paimon.deletionvectors | |
org.apache.paimon.mergetree.compact | |
org.apache.paimon.operation |
Constructor and Description |
---|
AutoCompactTask(DeletionVectorsMaintainer dvMaintainer,
List<DataFileMeta> toCompact,
BucketedAppendCompactManager.CompactRewriter rewriter,
CompactionMetrics.Reporter metricsReporter) |
BucketedAppendCompactManager(ExecutorService executor,
List<DataFileMeta> restored,
DeletionVectorsMaintainer dvMaintainer,
int minFileNum,
int maxFileNum,
long targetFileSize,
BucketedAppendCompactManager.CompactRewriter rewriter,
CompactionMetrics.Reporter metricsReporter) |
FullCompactTask(DeletionVectorsMaintainer dvMaintainer,
Collection<DataFileMeta> inputs,
long targetFileSize,
BucketedAppendCompactManager.CompactRewriter rewriter,
CompactionMetrics.Reporter metricsReporter) |
Modifier and Type | Method and Description |
---|---|
static CompactDeletionFile |
CompactDeletionFile.generateFiles(DeletionVectorsMaintainer maintainer)
Used by async compaction, when compaction task is completed, deletions file will be generated
immediately, so when updateCompactResult, we need to merge old deletion files (just delete
them).
|
static CompactDeletionFile |
CompactDeletionFile.lazyGeneration(DeletionVectorsMaintainer maintainer)
For sync compaction, only create deletion files when prepareCommit.
|
Constructor and Description |
---|
LazyCompactDeletionFile(DeletionVectorsMaintainer maintainer) |
Modifier and Type | Method and Description |
---|---|
DeletionVectorsMaintainer |
DeletionVectorsMaintainer.Factory.create() |
DeletionVectorsMaintainer |
DeletionVectorsMaintainer.Factory.createOrRestore(Long snapshotId,
BinaryRow partition) |
DeletionVectorsMaintainer |
DeletionVectorsMaintainer.Factory.createOrRestore(Long snapshotId,
BinaryRow partition,
int bucket) |
DeletionVectorsMaintainer |
DeletionVectorsMaintainer.Factory.createOrRestore(Map<String,DeletionVector> deletionVectors) |
Modifier and Type | Method and Description |
---|---|
static DeletionVector.Factory |
DeletionVector.factory(DeletionVectorsMaintainer dvMaintainer) |
Modifier and Type | Method and Description |
---|---|
MergeFunctionWrapper<ChangelogResult> |
LookupMergeTreeCompactRewriter.FirstRowMergeFunctionWrapperFactory.create(MergeFunctionFactory<KeyValue> mfFactory,
int outputLevel,
LookupLevels<Boolean> lookupLevels,
DeletionVectorsMaintainer deletionVectorsMaintainer) |
MergeFunctionWrapper<ChangelogResult> |
LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory.create(MergeFunctionFactory<KeyValue> mfFactory,
int outputLevel,
LookupLevels<T> lookupLevels,
DeletionVectorsMaintainer deletionVectorsMaintainer) |
MergeFunctionWrapper<ChangelogResult> |
LookupMergeTreeCompactRewriter.LookupMergeFunctionWrapperFactory.create(MergeFunctionFactory<KeyValue> mfFactory,
int outputLevel,
LookupLevels<T> lookupLevels,
DeletionVectorsMaintainer deletionVectorsMaintainer) |
Modifier and Type | Field and Description |
---|---|
protected DeletionVectorsMaintainer |
FileStoreWrite.State.deletionVectorsMaintainer |
DeletionVectorsMaintainer |
AbstractFileStoreWrite.WriterContainer.deletionVectorsMaintainer |
Modifier and Type | Method and Description |
---|---|
protected abstract RecordWriter<T> |
AbstractFileStoreWrite.createWriter(Long snapshotId,
BinaryRow partition,
int bucket,
List<DataFileMeta> restoreFiles,
long restoredMaxSeqNumber,
CommitIncrement restoreIncrement,
ExecutorService compactExecutor,
DeletionVectorsMaintainer deletionVectorsMaintainer) |
protected MergeTreeWriter |
KeyValueFileStoreWrite.createWriter(Long snapshotId,
BinaryRow partition,
int bucket,
List<DataFileMeta> restoreFiles,
long restoredMaxSeqNumber,
CommitIncrement restoreIncrement,
ExecutorService compactExecutor,
DeletionVectorsMaintainer dvMaintainer) |
protected RecordWriter<InternalRow> |
AppendOnlyFileStoreWrite.createWriter(Long snapshotId,
BinaryRow partition,
int bucket,
List<DataFileMeta> restoredFiles,
long restoredMaxSeqNumber,
CommitIncrement restoreIncrement,
ExecutorService compactExecutor,
DeletionVectorsMaintainer dvMaintainer) |
protected CompactManager |
AppendOnlyUnawareBucketFileStoreWrite.getCompactManager(BinaryRow partition,
int bucket,
List<DataFileMeta> restoredFiles,
ExecutorService compactExecutor,
DeletionVectorsMaintainer dvMaintainer) |
protected CompactManager |
AppendOnlyFixedBucketFileStoreWrite.getCompactManager(BinaryRow partition,
int bucket,
List<DataFileMeta> restoredFiles,
ExecutorService compactExecutor,
DeletionVectorsMaintainer dvMaintainer) |
protected abstract CompactManager |
AppendOnlyFileStoreWrite.getCompactManager(BinaryRow partition,
int bucket,
List<DataFileMeta> restoredFiles,
ExecutorService compactExecutor,
DeletionVectorsMaintainer dvMaintainer) |
Constructor and Description |
---|
State(BinaryRow partition,
int bucket,
long baseSnapshotId,
long lastModifiedCommitIdentifier,
Collection<DataFileMeta> dataFiles,
long maxSequenceNumber,
IndexMaintainer<T> indexMaintainer,
DeletionVectorsMaintainer deletionVectorsMaintainer,
CommitIncrement commitIncrement) |
WriterContainer(RecordWriter<T> writer,
IndexMaintainer<T> indexMaintainer,
DeletionVectorsMaintainer deletionVectorsMaintainer,
Long baseSnapshotId) |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.