org.apache.paimon.io

Class KeyValueThinDataFileWriterImpl

java.lang.Object

org.apache.paimon.io.SingleFileWriter<T,R>

org.apache.paimon.io.StatsCollectingSingleFileWriter<KeyValue,DataFileMeta>

org.apache.paimon.io.KeyValueDataFileWriter

org.apache.paimon.io.KeyValueThinDataFileWriterImpl

All Implemented Interfaces:

Closeable, AutoCloseable, FileWriter<KeyValue,DataFileMeta>

public class KeyValueThinDataFileWriterImpl
extends KeyValueDataFileWriter

Implementation of KeyValueDataFileWriter for thin data files. Thin data files only contain _SEQUENCE_NUMBER_, _ROW_KIND_ and value fields.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.io.SingleFileWriter

SingleFileWriter.AbortExecutor

Field Summary

Fields inherited from class org.apache.paimon.io.KeyValueDataFileWriter

keyType, valueType

Fields inherited from class org.apache.paimon.io.SingleFileWriter

closed, fileIO, outputBytes, path

Constructor Summary

Constructors

Constructor and Description

KeyValueThinDataFileWriterImpl(FileIO fileIO, FormatWriterFactory factory, Path path, java.util.function.Function<KeyValue,InternalRow> converter, RowType keyType, RowType valueType, SimpleStatsExtractor simpleStatsExtractor, long schemaId, int level, String compression, CoreOptions options, FileSource fileSource, FileIndexOptions fileIndexOptions, boolean isExternalPath) Constructs a KeyValueThinDataFileWriterImpl.

Method Summary

Methods inherited from class org.apache.paimon.io.KeyValueDataFileWriter

close, result, write

Methods inherited from class org.apache.paimon.io.StatsCollectingSingleFileWriter

fieldStats, writeBundle

Methods inherited from class org.apache.paimon.io.SingleFileWriter

abort, abortExecutor, path, reachTargetSize, recordCount, writeImpl

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.io.FileWriter

write, write, write

Constructor Detail

KeyValueThinDataFileWriterImpl

public KeyValueThinDataFileWriterImpl(FileIO fileIO,
                                      FormatWriterFactory factory,
                                      Path path,
                                      java.util.function.Function<KeyValue,InternalRow> converter,
                                      RowType keyType,
                                      RowType valueType,
                                      @Nullable
                                      SimpleStatsExtractor simpleStatsExtractor,
                                      long schemaId,
                                      int level,
                                      String compression,
                                      CoreOptions options,
                                      FileSource fileSource,
                                      FileIndexOptions fileIndexOptions,
                                      boolean isExternalPath)

Constructs a KeyValueThinDataFileWriterImpl.

Parameters:

fileIO - The file IO interface.

factory - The format writer factory.

path - The path to the file.

converter - The function to convert KeyValue to InternalRow.

keyType - The row type of the key.

valueType - The row type of the value.

simpleStatsExtractor - The simple stats extractor, can be null.

schemaId - The schema ID.

level - The level.

compression - The compression type.

options - The core options.

fileSource - The file source.

fileIndexOptions - The file index options.