org.apache.paimon.io

Class RowDataFileWriter

java.lang.Object

org.apache.paimon.io.SingleFileWriter<T,R>

org.apache.paimon.io.StatsCollectingSingleFileWriter<InternalRow,DataFileMeta>

org.apache.paimon.io.RowDataFileWriter

All Implemented Interfaces:

Closeable, AutoCloseable, FileWriter<InternalRow,DataFileMeta>

public class RowDataFileWriter
extends StatsCollectingSingleFileWriter<InternalRow,DataFileMeta>

A StatsCollectingSingleFileWriter to write data files containing InternalRow. Also produces DataFileMeta after writing a file.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.io.SingleFileWriter

SingleFileWriter.AbortExecutor

Field Summary

Fields inherited from class org.apache.paimon.io.SingleFileWriter

closed, fileIO, path

Constructor Summary

Constructors

Constructor and Description
RowDataFileWriter(FileIO fileIO, FormatWriterFactory factory, Path path, RowType writeSchema, SimpleStatsExtractor simpleStatsExtractor, long schemaId, LongCounter seqNumCounter, String fileCompression, SimpleColStatsCollector.Factory[] statsCollectors, FileIndexOptions fileIndexOptions, FileSource fileSource, boolean asyncFileWrite, boolean statsDenseStore)

Method Summary

Modifier and Type	Method and Description
void	close()
DataFileMeta	result()
void	write(InternalRow row) Add only one record to this file writer.

Methods inherited from class org.apache.paimon.io.StatsCollectingSingleFileWriter

fieldStats, writeBundle

Methods inherited from class org.apache.paimon.io.SingleFileWriter

abort, abortExecutor, path, reachTargetSize, recordCount, writeImpl

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.io.FileWriter

write, write, write

Constructor Detail

RowDataFileWriter

public RowDataFileWriter(FileIO fileIO,
                         FormatWriterFactory factory,
                         Path path,
                         RowType writeSchema,
                         @Nullable
                         SimpleStatsExtractor simpleStatsExtractor,
                         long schemaId,
                         LongCounter seqNumCounter,
                         String fileCompression,
                         SimpleColStatsCollector.Factory[] statsCollectors,
                         FileIndexOptions fileIndexOptions,
                         FileSource fileSource,
                         boolean asyncFileWrite,
                         boolean statsDenseStore)

Method Detail

write

public void write(InternalRow row)
           throws IOException

Description copied from interface: FileWriter

Add only one record to this file writer.

NOTE: If any exception occurs during writing, the writer should clean up useless files for the user.

Specified by:

write in interface FileWriter<InternalRow,DataFileMeta>

Overrides:

write in class StatsCollectingSingleFileWriter<InternalRow,DataFileMeta>

Parameters:

row - to write.

Throws:

IOException - if encounter any IO error.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class SingleFileWriter<InternalRow,DataFileMeta>

Throws:

IOException

result

public DataFileMeta result()
                    throws IOException

Returns:

the result for this closed file writer.

Throws:

IOException