Package | Description |
---|---|
org.apache.paimon.deletionvectors | |
org.apache.paimon.deletionvectors.append | |
org.apache.paimon.index | |
org.apache.paimon.operation |
Modifier and Type | Class and Description |
---|---|
class |
BitmapDeletionVector
A
DeletionVector based on RoaringBitmap32 , it only supports files with row count
not exceeding RoaringBitmap32.MAX_VALUE . |
Modifier and Type | Method and Description |
---|---|
DeletionVector |
ApplyDeletionVectorReader.deletionVector() |
DeletionVector |
ApplyDeletionFileRecordIterator.deletionVector() |
static DeletionVector |
DeletionVector.deserializeFromBytes(byte[] bytes)
Deserializes a deletion vector from a byte array.
|
static DeletionVector |
BitmapDeletionVector.deserializeFromDataInput(DataInput bis) |
static DeletionVector |
DeletionVector.read(FileIO fileIO,
DeletionFile deletionFile) |
DeletionVector |
DeletionVectorsIndexFile.readDeletionVector(DeletionFile deletionFile) |
Modifier and Type | Method and Description |
---|---|
Optional<DeletionVector> |
DeletionVector.Factory.create(String fileName) |
Optional<DeletionVector> |
DeletionVectorsMaintainer.deletionVectorOf(String fileName)
Retrieves the deletion vector associated with the specified file name.
|
Map<String,DeletionVector> |
DeletionVectorsMaintainer.deletionVectors() |
Map<String,DeletionVector> |
DeletionVectorsIndexFile.readAllDeletionVectors(IndexFileMeta fileMeta)
Reads all deletion vectors from a specified file.
|
Map<String,DeletionVector> |
DeletionVectorsIndexFile.readAllDeletionVectors(List<IndexFileMeta> indexFiles) |
Map<String,DeletionVector> |
DeletionVectorsIndexFile.readDeletionVector(Map<String,DeletionFile> dataFileToDeletionFiles)
Reads deletion vectors from a list of DeletionFile which belong to a same index file.
|
Modifier and Type | Method and Description |
---|---|
void |
DeletionVector.merge(DeletionVector deletionVector)
merge another
DeletionVector to this current one. |
void |
BitmapDeletionVector.merge(DeletionVector deletionVector) |
void |
DeletionVectorsMaintainer.mergeNewDeletion(String fileName,
DeletionVector deletionVector)
Merge a new deletion which marks the specified deletion vector with the given file name, if
the previous deletion vector exist, merge the old one.
|
void |
DeletionVectorsMaintainer.notifyNewDeletion(String fileName,
DeletionVector deletionVector)
Notifies a new deletion which marks the specified deletion vector with the given file name.
|
Modifier and Type | Method and Description |
---|---|
DeletionVectorsMaintainer |
DeletionVectorsMaintainer.Factory.createOrRestore(Map<String,DeletionVector> deletionVectors) |
List<IndexFileMeta> |
DeletionVectorIndexFileWriter.write(Map<String,DeletionVector> input)
For unaware-bucket mode, this method will write out multiple index files, else, it will write
out only one index file.
|
List<IndexFileMeta> |
DeletionVectorsIndexFile.write(Map<String,DeletionVector> input)
Write deletion vectors to a new file, the format of this file can be referenced at: PIP-16.
|
Constructor and Description |
---|
ApplyDeletionFileRecordIterator(FileRecordIterator<InternalRow> iterator,
DeletionVector deletionVector) |
ApplyDeletionVectorReader(FileRecordReader<InternalRow> reader,
DeletionVector deletionVector) |
Modifier and Type | Method and Description |
---|---|
DeletionVector |
UnawareAppendDeletionFileMaintainer.getDeletionVector(String dataFile) |
Modifier and Type | Method and Description |
---|---|
void |
BucketedAppendDeletionFileMaintainer.notifyNewDeletionVector(String dataFile,
DeletionVector deletionVector) |
void |
UnawareAppendDeletionFileMaintainer.notifyNewDeletionVector(String dataFile,
DeletionVector deletionVector) |
void |
AppendDeletionFileMaintainer.notifyNewDeletionVector(String dataFile,
DeletionVector deletionVector) |
Modifier and Type | Method and Description |
---|---|
Map<String,DeletionVector> |
IndexFileHandler.readAllDeletionVectors(List<IndexFileMeta> fileMetas) |
Modifier and Type | Method and Description |
---|---|
List<IndexFileMeta> |
IndexFileHandler.writeDeletionVectorsIndex(Map<String,DeletionVector> deletionVectors) |
Modifier and Type | Method and Description |
---|---|
List<DataFileMeta> |
AppendOnlyFileStoreWrite.compactRewrite(BinaryRow partition,
int bucket,
java.util.function.Function<String,DeletionVector> dvFactory,
List<DataFileMeta> toCompact) |
RecordReader<InternalRow> |
RawFileSplitRead.createReader(BinaryRow partition,
int bucket,
List<DataFileMeta> files,
List<IOExceptionSupplier<DeletionVector>> dvFactories) |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.