org.apache.paimon.mergetree

Class SortBufferWriteBuffer

java.lang.Object

org.apache.paimon.mergetree.SortBufferWriteBuffer

All Implemented Interfaces:

WriteBuffer

public class SortBufferWriteBuffer
extends Object
implements WriteBuffer

A WriteBuffer which stores records in BinaryInMemorySortBuffer.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.paimon.mergetree.WriteBuffer

WriteBuffer.KvConsumer

Constructor Summary

Constructors

Constructor and Description
SortBufferWriteBuffer(RowType keyType, RowType valueType, FieldsComparator userDefinedSeqComparator, MemorySegmentPool memoryPool, boolean spillable, MemorySize maxDiskSize, int sortMaxFan, CompressOptions compression, IOManager ioManager)

Method Summary

Modifier and Type	Method and Description
void	clear() Removes all records from this table.
boolean	flushMemory() Flush memory, return false if not supported.
void	forEach(Comparator<InternalRow> keyComparator, MergeFunction<KeyValue> mergeFunction, WriteBuffer.KvConsumer rawConsumer, WriteBuffer.KvConsumer mergedConsumer) Performs the given action for each remaining element in this buffer until all elements have been processed or the action throws an exception.
long	memoryOccupancy() Memory occupancy size of this table.
boolean	put(long sequenceNumber, RowKind valueKind, InternalRow key, InternalRow value) Put a record with sequence number and value kind.
int	size() Record size of this table.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SortBufferWriteBuffer

public SortBufferWriteBuffer(RowType keyType,
                             RowType valueType,
                             @Nullable
                             FieldsComparator userDefinedSeqComparator,
                             MemorySegmentPool memoryPool,
                             boolean spillable,
                             MemorySize maxDiskSize,
                             int sortMaxFan,
                             CompressOptions compression,
                             IOManager ioManager)

Method Detail

put

public boolean put(long sequenceNumber,
                   RowKind valueKind,
                   InternalRow key,
                   InternalRow value)
            throws IOException

Description copied from interface: WriteBuffer

Put a record with sequence number and value kind.

Specified by:

put in interface WriteBuffer

Returns:

True, if the record was successfully written, false, if the mem table was full.

Throws:

IOException

size

public int size()

Description copied from interface: WriteBuffer

Record size of this table.

Specified by:

size in interface WriteBuffer

memoryOccupancy

public long memoryOccupancy()

Description copied from interface: WriteBuffer

Memory occupancy size of this table.

Specified by:

memoryOccupancy in interface WriteBuffer

flushMemory

public boolean flushMemory()
                    throws IOException

Description copied from interface: WriteBuffer

Flush memory, return false if not supported.

Specified by:

flushMemory in interface WriteBuffer

Throws:

IOException

forEach

public void forEach(Comparator<InternalRow> keyComparator,
                    MergeFunction<KeyValue> mergeFunction,
                    @Nullable
                    WriteBuffer.KvConsumer rawConsumer,
                    WriteBuffer.KvConsumer mergedConsumer)
             throws IOException

Description copied from interface: WriteBuffer

Performs the given action for each remaining element in this buffer until all elements have been processed or the action throws an exception.

Specified by:

forEach in interface WriteBuffer

rawConsumer - consumer to consume records without merging.

mergedConsumer - consumer to consume records after merging.

Throws:

IOException

clear

public void clear()

Description copied from interface: WriteBuffer

Removes all records from this table. The table will be empty after this call returns.

Specified by:

clear in interface WriteBuffer