Uses of Class
org.apache.paimon.KeyValue

Packages that use KeyValue

Package	Description
org.apache.paimon
org.apache.paimon.index
org.apache.paimon.io
org.apache.paimon.mergetree
org.apache.paimon.mergetree.compact
org.apache.paimon.mergetree.compact.aggregate
org.apache.paimon.operation
org.apache.paimon.table
org.apache.paimon.table.source
org.apache.paimon.utils

Uses of KeyValue in org.apache.paimon

Methods in org.apache.paimon that return KeyValue

Modifier and Type	Method and Description
KeyValue	KeyValue.copy(InternalRowSerializer keySerializer, InternalRowSerializer valueSerializer)
KeyValue	KeyValueSerializer.fromRow(InternalRow row)
KeyValue	KeyValueSerializer.getReusedKv()
KeyValue	KeyValue.replace(InternalRow key, long sequenceNumber, RowKind valueKind, InternalRow value)
KeyValue	KeyValue.replace(InternalRow key, RowKind valueKind, InternalRow value)
KeyValue	KeyValue.replaceKey(InternalRow key)
KeyValue	KeyValue.replaceValue(InternalRow value)
KeyValue	KeyValue.replaceValueKind(RowKind valueKind)
KeyValue	KeyValue.setLevel(int level)

Methods in org.apache.paimon with parameters of type KeyValue

Modifier and Type	Method and Description
InternalRow	KeyValueSerializer.toRow(KeyValue record)

Constructor parameters in org.apache.paimon with type arguments of type KeyValue

Constructor and Description
KeyValueFileStore(FileIO fileIO, SchemaManager schemaManager, TableSchema schema, boolean crossPartitionUpdate, CoreOptions options, RowType partitionType, RowType bucketKeyType, RowType keyType, RowType valueType, KeyValueFieldsExtractor keyValueFieldsExtractor, MergeFunctionFactory<KeyValue> mfFactory, String tableName, CatalogEnvironment catalogEnvironment)

Uses of KeyValue in org.apache.paimon.index

Methods in org.apache.paimon.index that return types with arguments of type KeyValue

Modifier and Type	Method and Description
IndexMaintainer<KeyValue>	HashIndexMaintainer.Factory.createOrRestore(Long snapshotId, BinaryRow partition, int bucket)

Methods in org.apache.paimon.index with parameters of type KeyValue

Modifier and Type	Method and Description
void	HashIndexMaintainer.notifyNewRecord(KeyValue record)

Uses of KeyValue in org.apache.paimon.io

Methods in org.apache.paimon.io that return types with arguments of type KeyValue

Modifier and Type	Method and Description
RecordReader<KeyValue>	KeyValueFileReaderFactory.createRecordReader(DataFileMeta file)
RecordReader<KeyValue>	KeyValueFileReaderFactory.createRecordReader(long schemaId, String fileName, long fileSize, int level)
RollingFileWriter<KeyValue,DataFileMeta>	KeyValueFileWriterFactory.createRollingChangelogFileWriter(int level)
RollingFileWriter<KeyValue,DataFileMeta>	KeyValueFileWriterFactory.createRollingMergeTreeFileWriter(int level, FileSource fileSource)
RecordReader.RecordIterator<KeyValue>	KeyValueDataFileRecordReader.readBatch()
FileReaderFactory<KeyValue>	RecordLevelExpire.wrap(FileReaderFactory<KeyValue> readerFactory)

Methods in org.apache.paimon.io with parameters of type KeyValue

Modifier and Type	Method and Description
void	KeyValueDataFileWriter.write(KeyValue kv)

Method parameters in org.apache.paimon.io with type arguments of type KeyValue

Modifier and Type	Method and Description
FileReaderFactory<KeyValue>	RecordLevelExpire.wrap(FileReaderFactory<KeyValue> readerFactory)

Constructor parameters in org.apache.paimon.io with type arguments of type KeyValue

Constructor and Description
KeyValueDataFileWriter(FileIO fileIO, FormatWriterFactory factory, Path path, java.util.function.Function<KeyValue,InternalRow> converter, RowType keyType, RowType valueType, SimpleStatsExtractor simpleStatsExtractor, long schemaId, int level, String compression, CoreOptions options, FileSource fileSource, FileIndexOptions fileIndexOptions)

Uses of KeyValue in org.apache.paimon.mergetree

Methods in org.apache.paimon.mergetree that return KeyValue

Modifier and Type	Method and Description
KeyValue	LookupLevels.PositionedKeyValue.keyValue()
KeyValue	LookupLevels.KeyValueProcessor.readFromDisk(InternalRow key, int level, byte[] bytes, String fileName)

Methods in org.apache.paimon.mergetree that return types with arguments of type KeyValue

Modifier and Type	Method and Description
RecordReader.RecordIterator<KeyValue>	DropDeleteReader.readBatch()

Methods in org.apache.paimon.mergetree with parameters of type KeyValue

Modifier and Type	Method and Description
void	WriteBuffer.KvConsumer.accept(KeyValue kv)
byte[]	LookupLevels.ValueProcessor.persistToDisk(KeyValue kv)
byte[]	LookupLevels.KeyValueProcessor.persistToDisk(KeyValue kv)
byte[]	LookupLevels.ContainsValueProcessor.persistToDisk(KeyValue kv)
byte[]	LookupLevels.PositionedKeyValueProcessor.persistToDisk(KeyValue kv)
default byte[]	LookupLevels.ValueProcessor.persistToDisk(KeyValue kv, long rowPosition)
byte[]	LookupLevels.PositionedKeyValueProcessor.persistToDisk(KeyValue kv, long rowPosition)
void	MergeTreeWriter.write(KeyValue kv)

Method parameters in org.apache.paimon.mergetree with type arguments of type KeyValue

Modifier and Type	Method and Description
void	SortBufferWriteBuffer.forEach(Comparator<InternalRow> keyComparator, MergeFunction<KeyValue> mergeFunction, WriteBuffer.KvConsumer rawConsumer, WriteBuffer.KvConsumer mergedConsumer)
void	WriteBuffer.forEach(Comparator<InternalRow> keyComparator, MergeFunction<KeyValue> mergeFunction, WriteBuffer.KvConsumer rawConsumer, WriteBuffer.KvConsumer mergedConsumer) Performs the given action for each remaining element in this buffer until all elements have been processed or the action throws an exception.
<T> RecordReader<T>	MergeSorter.mergeSort(List<SizedReaderSupplier<KeyValue>> lazyReaders, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunction)
<T> RecordReader<T>	MergeSorter.mergeSortNoSpill(List<? extends ReaderSupplier<KeyValue>> lazyReaders, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunction)
static <T> RecordReader<T>	MergeTreeReaders.readerForMergeTree(List<List<SortedRun>> sections, FileReaderFactory<KeyValue> readerFactory, Comparator<InternalRow> userKeyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunctionWrapper, MergeSorter mergeSorter)
static <T> RecordReader<T>	MergeTreeReaders.readerForSection(List<SortedRun> section, FileReaderFactory<KeyValue> readerFactory, Comparator<InternalRow> userKeyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunctionWrapper, MergeSorter mergeSorter)

Constructors in org.apache.paimon.mergetree with parameters of type KeyValue

Constructor and Description
PositionedKeyValue(KeyValue keyValue, String fileName, long rowPosition)

Constructor parameters in org.apache.paimon.mergetree with type arguments of type KeyValue

Constructor and Description
DropDeleteReader(RecordReader<KeyValue> reader)
LookupLevels(Levels levels, Comparator<InternalRow> keyComparator, RowType keyType, LookupLevels.ValueProcessor<T> valueProcessor, IOFunction<DataFileMeta,RecordReader<KeyValue>> fileReaderFactory, java.util.function.Function<String,File> localFileFactory, LookupStoreFactory lookupStoreFactory, java.util.function.Function<Long,BloomFilter.Builder> bfGenerator, org.apache.paimon.shade.caffeine2.com.github.benmanes.caffeine.cache.Cache<String,LookupFile> lookupFileCache)
MergeTreeWriter(boolean writeBufferSpillable, MemorySize maxDiskSize, int sortMaxFan, CompressOptions sortCompression, IOManager ioManager, CompactManager compactManager, long maxSequenceNumber, Comparator<InternalRow> keyComparator, MergeFunction<KeyValue> mergeFunction, KeyValueFileWriterFactory writerFactory, boolean commitForceCompact, CoreOptions.ChangelogProducer changelogProducer, CommitIncrement increment, FieldsComparator userDefinedSeqComparator)

Uses of KeyValue in org.apache.paimon.mergetree.compact

Fields in org.apache.paimon.mergetree.compact with type parameters of type KeyValue

Modifier and Type	Field and Description
protected MergeFunctionFactory<KeyValue>	MergeTreeCompactRewriter.mfFactory
protected FileReaderFactory<KeyValue>	MergeTreeCompactRewriter.readerFactory

Methods in org.apache.paimon.mergetree.compact that return KeyValue

Modifier and Type	Method and Description
KeyValue	FirstRowMergeFunction.getResult()
KeyValue	LookupMergeFunction.getResult()
KeyValue	DeduplicateMergeFunction.getResult()
KeyValue	ReducerMergeFunctionWrapper.getResult() Get current value of the MergeFunction helper.
KeyValue	PartialUpdateMergeFunction.getResult()
KeyValue	ChangelogResult.result() Latest result (result of merge function) for this key.

Methods in org.apache.paimon.mergetree.compact that return types with arguments of type KeyValue

Modifier and Type	Method and Description
List<KeyValue>	ChangelogResult.changelogs()
static MergeFunctionFactory<KeyValue>	DeduplicateMergeFunction.factory()
static MergeFunctionFactory<KeyValue>	DeduplicateMergeFunction.factory(Options options)
static MergeFunctionFactory<KeyValue>	PartialUpdateMergeFunction.factory(Options options, RowType rowType, List<String> primaryKeys)
static MergeFunctionFactory<KeyValue>	FirstRowMergeFunction.factory(Options options, RowType keyType, RowType valueType)
static MergeFunctionFactory<KeyValue>	LookupMergeFunction.wrap(MergeFunctionFactory<KeyValue> wrapped, RowType keyType, RowType valueType)

Methods in org.apache.paimon.mergetree.compact with parameters of type KeyValue

Modifier and Type	Method and Description
void	FirstRowMergeFunctionWrapper.add(KeyValue kv)
void	LookupChangelogMergeFunctionWrapper.add(KeyValue kv)
void	FirstRowMergeFunction.add(KeyValue kv)
void	FullChangelogMergeFunctionWrapper.add(KeyValue kv)
void	MergeFunction.add(KeyValue kv) Add the given KeyValue to the merge function.
void	LookupMergeFunction.add(KeyValue kv)
void	DeduplicateMergeFunction.add(KeyValue kv)
void	ReducerMergeFunctionWrapper.add(KeyValue kv) Adds the given KeyValue to the MergeFunction helper.
void	MergeFunctionWrapper.add(KeyValue kv)
void	PartialUpdateMergeFunction.add(KeyValue kv)
ChangelogResult	ChangelogResult.addChangelog(KeyValue record)
ChangelogResult	ChangelogResult.setResult(KeyValue result)
ChangelogResult	ChangelogResult.setResultIfNotRetract(KeyValue result)

Method parameters in org.apache.paimon.mergetree.compact with type arguments of type KeyValue

Modifier and Type	Method and Description
MergeFunctionWrapper<ChangelogResult>	LookupMergeTreeCompactRewriter.FirstRowMergeFunctionWrapperFactory.create(MergeFunctionFactory<KeyValue> mfFactory, int outputLevel, LookupLevels<Boolean> lookupLevels, DeletionVectorsMaintainer deletionVectorsMaintainer)
MergeFunctionWrapper<ChangelogResult>	LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory.create(MergeFunctionFactory<KeyValue> mfFactory, int outputLevel, LookupLevels<T> lookupLevels, DeletionVectorsMaintainer deletionVectorsMaintainer)
MergeFunctionWrapper<ChangelogResult>	LookupMergeTreeCompactRewriter.LookupMergeFunctionWrapperFactory.create(MergeFunctionFactory<KeyValue> mfFactory, int outputLevel, LookupLevels<T> lookupLevels, DeletionVectorsMaintainer deletionVectorsMaintainer)
static <T> SortMergeReader<T>	SortMergeReader.createSortMergeReader(List<RecordReader<KeyValue>> readers, Comparator<InternalRow> userKeyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunctionWrapper, CoreOptions.SortEngine sortEngine)
static MergeFunctionFactory<KeyValue>	LookupMergeFunction.wrap(MergeFunctionFactory<KeyValue> wrapped, RowType keyType, RowType valueType)

Constructor parameters in org.apache.paimon.mergetree.compact with type arguments of type KeyValue

Constructor and Description
ChangelogMergeTreeRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, boolean produceChangelog, boolean forceDropDelete)
ChangelogMergeTreeRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, boolean produceChangelog, boolean forceDropDelete)
FirstRowMergeFunctionWrapper(MergeFunctionFactory<KeyValue> mergeFunctionFactory, Filter<InternalRow> contains)
FullChangelogMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction, int maxLevel, RecordEqualiser valueEqualiser)
FullChangelogMergeTreeCompactRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, RecordEqualiser valueEqualiser)
FullChangelogMergeTreeCompactRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, RecordEqualiser valueEqualiser)
LookupChangelogMergeFunctionWrapper(MergeFunctionFactory<KeyValue> mergeFunctionFactory, java.util.function.Function<InternalRow,T> lookup, RecordEqualiser valueEqualiser, LookupStrategy lookupStrategy, DeletionVectorsMaintainer deletionVectorsMaintainer, UserDefinedSeqComparator userDefinedSeqComparator)
LookupMergeFunction(MergeFunction<KeyValue> mergeFunction, RowType keyType, RowType valueType)
LookupMergeTreeCompactRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, LookupLevels<T> lookupLevels, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory<T> wrapperFactory, boolean produceChangelog, DeletionVectorsMaintainer dvMaintainer, CoreOptions options)
LookupMergeTreeCompactRewriter(int maxLevel, CoreOptions.MergeEngine mergeEngine, LookupLevels<T> lookupLevels, FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter, LookupMergeTreeCompactRewriter.MergeFunctionWrapperFactory<T> wrapperFactory, boolean produceChangelog, DeletionVectorsMaintainer dvMaintainer, CoreOptions options)
MergeTreeCompactRewriter(FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter)
MergeTreeCompactRewriter(FileReaderFactory<KeyValue> readerFactory, KeyValueFileWriterFactory writerFactory, Comparator<InternalRow> keyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionFactory<KeyValue> mfFactory, MergeSorter mergeSorter)
ReducerMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction)
SortMergeReaderWithLoserTree(List<RecordReader<KeyValue>> readers, Comparator<InternalRow> userKeyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunctionWrapper)
SortMergeReaderWithMinHeap(List<RecordReader<KeyValue>> readers, Comparator<InternalRow> userKeyComparator, FieldsComparator userDefinedSeqComparator, MergeFunctionWrapper<T> mergeFunctionWrapper)

Uses of KeyValue in org.apache.paimon.mergetree.compact.aggregate

Methods in org.apache.paimon.mergetree.compact.aggregate that return KeyValue

Modifier and Type	Method and Description
KeyValue	AggregateMergeFunction.getResult()

Methods in org.apache.paimon.mergetree.compact.aggregate that return types with arguments of type KeyValue

Modifier and Type	Method and Description
static MergeFunctionFactory<KeyValue>	AggregateMergeFunction.factory(Options conf, List<String> tableNames, List<DataType> tableTypes, List<String> primaryKeys)

Methods in org.apache.paimon.mergetree.compact.aggregate with parameters of type KeyValue

Modifier and Type	Method and Description
void	AggregateMergeFunction.add(KeyValue kv)

Uses of KeyValue in org.apache.paimon.operation

Methods in org.apache.paimon.operation that return types with arguments of type KeyValue

Modifier and Type	Method and Description
RecordReader<KeyValue>	MergeFileSplitRead.createMergeReader(BinaryRow partition, int bucket, List<DataFileMeta> files, List<DeletionFile> deletionFiles, boolean keepDelete)
RecordReader<KeyValue>	MergeFileSplitRead.createNoMergeReader(BinaryRow partition, int bucket, List<DataFileMeta> files, List<DeletionFile> deletionFiles, boolean onlyFilterKey)
RecordReader<KeyValue>	MergeFileSplitRead.createReader(DataSplit split)
protected java.util.function.Function<AbstractFileStoreWrite.WriterContainer<KeyValue>,Boolean>	KeyValueFileStoreWrite.createWriterCleanChecker()
RecordReader.RecordIterator<KeyValue>	ReverseReader.readBatch()

Constructor parameters in org.apache.paimon.operation with type arguments of type KeyValue

Constructor and Description
KeyValueFileStoreWrite(FileIO fileIO, SchemaManager schemaManager, TableSchema schema, String commitUser, RowType partitionType, RowType keyType, RowType valueType, java.util.function.Supplier<Comparator<InternalRow>> keyComparatorSupplier, java.util.function.Supplier<FieldsComparator> udsComparatorSupplier, java.util.function.Supplier<RecordEqualiser> logDedupEqualSupplier, MergeFunctionFactory<KeyValue> mfFactory, FileStorePathFactory pathFactory, Map<String,FileStorePathFactory> format2PathFactory, SnapshotManager snapshotManager, FileStoreScan scan, IndexMaintainer.Factory<KeyValue> indexFactory, DeletionVectorsMaintainer.Factory deletionVectorsMaintainerFactory, CoreOptions options, KeyValueFieldsExtractor extractor, String tableName)
KeyValueFileStoreWrite(FileIO fileIO, SchemaManager schemaManager, TableSchema schema, String commitUser, RowType partitionType, RowType keyType, RowType valueType, java.util.function.Supplier<Comparator<InternalRow>> keyComparatorSupplier, java.util.function.Supplier<FieldsComparator> udsComparatorSupplier, java.util.function.Supplier<RecordEqualiser> logDedupEqualSupplier, MergeFunctionFactory<KeyValue> mfFactory, FileStorePathFactory pathFactory, Map<String,FileStorePathFactory> format2PathFactory, SnapshotManager snapshotManager, FileStoreScan scan, IndexMaintainer.Factory<KeyValue> indexFactory, DeletionVectorsMaintainer.Factory deletionVectorsMaintainerFactory, CoreOptions options, KeyValueFieldsExtractor extractor, String tableName)
MergeFileSplitRead(CoreOptions options, TableSchema schema, RowType keyType, RowType valueType, Comparator<InternalRow> keyComparator, MergeFunctionFactory<KeyValue> mfFactory, KeyValueFileReaderFactory.Builder readerFactoryBuilder)
ReverseReader(RecordReader<KeyValue> reader)

Uses of KeyValue in org.apache.paimon.table

Methods in org.apache.paimon.table that return types with arguments of type KeyValue

Modifier and Type	Method and Description
static MergeFunctionFactory<KeyValue>	PrimaryKeyTableUtils.createMergeFunctionFactory(TableSchema tableSchema, KeyValueFieldsExtractor extractor)

Uses of KeyValue in org.apache.paimon.table.source

Methods in org.apache.paimon.table.source that return KeyValue

Modifier and Type	Method and Description
KeyValue	ResetRowKindRecordIterator.nextKeyValue()

Method parameters in org.apache.paimon.table.source with type arguments of type KeyValue

Modifier and Type	Method and Description
static RecordReader<InternalRow>	KeyValueTableRead.unwrap(RecordReader<KeyValue> reader)

Constructor parameters in org.apache.paimon.table.source with type arguments of type KeyValue

Constructor and Description
ResetRowKindRecordIterator(RecordReader.RecordIterator<KeyValue> kvIterator)
ValueContentRowDataRecordIterator(RecordReader.RecordIterator<KeyValue> kvIterator)

Uses of KeyValue in org.apache.paimon.utils

Methods in org.apache.paimon.utils that return KeyValue

Modifier and Type	Method and Description
KeyValue	KeyValueWithLevelNoReusingSerializer.fromRow(InternalRow row)

Methods in org.apache.paimon.utils with parameters of type KeyValue

Modifier and Type	Method and Description
InternalRow	KeyValueWithLevelNoReusingSerializer.toRow(KeyValue kv)