org.apache.paimon.operation

Class KeyValueFileStoreWrite

java.lang.Object

org.apache.paimon.operation.AbstractFileStoreWrite<T>

org.apache.paimon.operation.MemoryFileStoreWrite<KeyValue>

org.apache.paimon.operation.KeyValueFileStoreWrite

All Implemented Interfaces:

FileStoreWrite<KeyValue>, Restorable<List<FileStoreWrite.State<KeyValue>>>

public class KeyValueFileStoreWrite
extends MemoryFileStoreWrite<KeyValue>

FileStoreWrite for KeyValueFileStore.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.operation.AbstractFileStoreWrite

AbstractFileStoreWrite.WriterContainer<T>

Nested classes/interfaces inherited from interface org.apache.paimon.operation.FileStoreWrite

FileStoreWrite.State<T>

Field Summary

Fields inherited from class org.apache.paimon.operation.MemoryFileStoreWrite

cacheManager

Fields inherited from class org.apache.paimon.operation.AbstractFileStoreWrite

compactionMetrics, ioManager, isStreamingMode, snapshotManager, tableName, writers

Constructor Summary

Constructors

Constructor and Description

KeyValueFileStoreWrite(FileIO fileIO, SchemaManager schemaManager, TableSchema schema, String commitUser, RowType partitionType, RowType keyType, RowType valueType, java.util.function.Supplier<Comparator<InternalRow>> keyComparatorSupplier, java.util.function.Supplier<FieldsComparator> udsComparatorSupplier, java.util.function.Supplier<RecordEqualiser> logDedupEqualSupplier, MergeFunctionFactory<KeyValue> mfFactory, FileStorePathFactory pathFactory, Map<String,FileStorePathFactory> format2PathFactory, SnapshotManager snapshotManager, FileStoreScan scan, IndexMaintainer.Factory<KeyValue> indexFactory, DeletionVectorsMaintainer.Factory deletionVectorsMaintainerFactory, CoreOptions options, KeyValueFieldsExtractor extractor, String tableName)

Method Summary

Modifier and Type	Method and Description
boolean	bufferSpillable()
void	close() Close the writer.
protected MergeTreeWriter	createWriter(Long snapshotId, BinaryRow partition, int bucket, List<DataFileMeta> restoreFiles, long restoredMaxSeqNumber, CommitIncrement restoreIncrement, ExecutorService compactExecutor, DeletionVectorsMaintainer dvMaintainer)

Methods inherited from class org.apache.paimon.operation.MemoryFileStoreWrite

notifyNewWriter, prepareCommit, withMemoryPoolFactory, withMetricRegistry

Methods inherited from class org.apache.paimon.operation.AbstractFileStoreWrite

checkpoint, compact, createWriterContainer, forceBufferSpill, getActiveBuckets, getCompactExecutor, getWriterWrapper, notifyNewFiles, restore, withCompactExecutor, withExecutionMode, withIgnorePreviousFiles, withInsertOnly, withIOManager, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.operation.FileStoreWrite

withMemoryPool

Constructor Detail

KeyValueFileStoreWrite

public KeyValueFileStoreWrite(FileIO fileIO,
                              SchemaManager schemaManager,
                              TableSchema schema,
                              String commitUser,
                              RowType partitionType,
                              RowType keyType,
                              RowType valueType,
                              java.util.function.Supplier<Comparator<InternalRow>> keyComparatorSupplier,
                              java.util.function.Supplier<FieldsComparator> udsComparatorSupplier,
                              java.util.function.Supplier<RecordEqualiser> logDedupEqualSupplier,
                              MergeFunctionFactory<KeyValue> mfFactory,
                              FileStorePathFactory pathFactory,
                              Map<String,FileStorePathFactory> format2PathFactory,
                              SnapshotManager snapshotManager,
                              FileStoreScan scan,
                              @Nullable
                              IndexMaintainer.Factory<KeyValue> indexFactory,
                              @Nullable
                              DeletionVectorsMaintainer.Factory deletionVectorsMaintainerFactory,
                              CoreOptions options,
                              KeyValueFieldsExtractor extractor,
                              String tableName)

Method Detail

createWriter

protected MergeTreeWriter createWriter(@Nullable
                                       Long snapshotId,
                                       BinaryRow partition,
                                       int bucket,
                                       List<DataFileMeta> restoreFiles,
                                       long restoredMaxSeqNumber,
                                       @Nullable
                                       CommitIncrement restoreIncrement,
                                       ExecutorService compactExecutor,
                                       @Nullable
                                       DeletionVectorsMaintainer dvMaintainer)

Specified by:

createWriter in class AbstractFileStoreWrite<KeyValue>

bufferSpillable

@VisibleForTesting
public boolean bufferSpillable()

close

public void close()
           throws Exception

Description copied from interface: FileStoreWrite

Close the writer.

Specified by:

close in interface FileStoreWrite<KeyValue>

Overrides:

close in class MemoryFileStoreWrite<KeyValue>

Throws:

Exception - the thrown exception