Package | Description |
---|---|
org.apache.paimon.mergetree | |
org.apache.paimon.mergetree.compact | |
org.apache.paimon.mergetree.compact.aggregate | |
org.apache.paimon.mergetree.localmerge |
Modifier and Type | Method and Description |
---|---|
void |
SortBufferWriteBuffer.forEach(Comparator<InternalRow> keyComparator,
MergeFunction<KeyValue> mergeFunction,
WriteBuffer.KvConsumer rawConsumer,
WriteBuffer.KvConsumer mergedConsumer) |
void |
WriteBuffer.forEach(Comparator<InternalRow> keyComparator,
MergeFunction<KeyValue> mergeFunction,
WriteBuffer.KvConsumer rawConsumer,
WriteBuffer.KvConsumer mergedConsumer)
Performs the given action for each remaining element in this buffer until all elements have
been processed or the action throws an exception.
|
Constructor and Description |
---|
MergeTreeWriter(boolean writeBufferSpillable,
MemorySize maxDiskSize,
int sortMaxFan,
CompressOptions sortCompression,
IOManager ioManager,
CompactManager compactManager,
long maxSequenceNumber,
Comparator<InternalRow> keyComparator,
MergeFunction<KeyValue> mergeFunction,
KeyValueFileWriterFactory writerFactory,
boolean commitForceCompact,
CoreOptions.ChangelogProducer changelogProducer,
CommitIncrement increment,
FieldsComparator userDefinedSeqComparator) |
Modifier and Type | Class and Description |
---|---|
class |
DeduplicateMergeFunction
A
MergeFunction where key is primary key (unique) and value is the full record, only keep
the latest one. |
class |
FirstRowMergeFunction
A
MergeFunction where key is primary key (unique) and value is the full record, only keep
the first one. |
class |
LookupMergeFunction
A
MergeFunction for lookup, this wrapper only considers the latest high level record,
because each merge will query the old merged record, so the latest high level record should be
the final merged value. |
class |
PartialUpdateMergeFunction
A
MergeFunction where key is primary key (unique) and value is the partial record, update
non-null fields on merge. |
Modifier and Type | Method and Description |
---|---|
default MergeFunction<T> |
MergeFunctionFactory.create() |
MergeFunction<T> |
MergeFunctionFactory.create(int[][] projection) |
Constructor and Description |
---|
FullChangelogMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction,
int maxLevel,
RecordEqualiser valueEqualiser) |
LookupMergeFunction(MergeFunction<KeyValue> mergeFunction,
RowType keyType,
RowType valueType) |
ReducerMergeFunctionWrapper(MergeFunction<KeyValue> mergeFunction) |
Modifier and Type | Class and Description |
---|---|
class |
AggregateMergeFunction
A
MergeFunction where key is primary key (unique) and value is the partial record,
pre-aggregate non-null fields on merge. |
Constructor and Description |
---|
HashMapLocalMerger(RowType rowType,
List<String> primaryKeys,
MemorySegmentPool memoryPool,
MergeFunction<KeyValue> mergeFunction,
FieldsComparator userDefinedSeqComparator) |
SortBufferLocalMerger(SortBufferWriteBuffer sortBuffer,
RecordComparator keyComparator,
MergeFunction<KeyValue> mergeFunction) |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.