org.apache.paimon.io

Class StatsCollectingSingleFileWriter<T,R>

java.lang.Object

org.apache.paimon.io.SingleFileWriter<T,R>

org.apache.paimon.io.StatsCollectingSingleFileWriter<T,R>

Type Parameters:

T - type of records to write.

R - type of result to produce after writing a file.

All Implemented Interfaces:

Closeable, AutoCloseable, FileWriter<T,R>

Direct Known Subclasses:

KeyValueDataFileWriter, RowDataFileWriter

public abstract class StatsCollectingSingleFileWriter<T,R>
extends SingleFileWriter<T,R>

A SingleFileWriter which also produces statistics for each written field.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.io.SingleFileWriter

SingleFileWriter.AbortExecutor

Field Summary

Fields inherited from class org.apache.paimon.io.SingleFileWriter

closed, fileIO, path

Constructor Summary

Constructors

Constructor and Description
StatsCollectingSingleFileWriter(FileIO fileIO, FormatWriterFactory factory, Path path, java.util.function.Function<T,InternalRow> converter, RowType writeSchema, SimpleStatsExtractor simpleStatsExtractor, String compression, SimpleColStatsCollector.Factory[] statsCollectors, boolean asyncWrite)

Method Summary

Modifier and Type	Method and Description
SimpleColStats[]	fieldStats()
void	write(T record) Add only one record to this file writer.
void	writeBundle(BundleRecords bundle)

Methods inherited from class org.apache.paimon.io.SingleFileWriter

abort, abortExecutor, close, path, reachTargetSize, recordCount, writeImpl

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.io.FileWriter

result, write, write, write

Constructor Detail

StatsCollectingSingleFileWriter

public StatsCollectingSingleFileWriter(FileIO fileIO,
                                       FormatWriterFactory factory,
                                       Path path,
                                       java.util.function.Function<T,InternalRow> converter,
                                       RowType writeSchema,
                                       @Nullable
                                       SimpleStatsExtractor simpleStatsExtractor,
                                       String compression,
                                       SimpleColStatsCollector.Factory[] statsCollectors,
                                       boolean asyncWrite)

Method Detail

write

public void write(T record)
           throws IOException

Description copied from interface: FileWriter

Add only one record to this file writer.

NOTE: If any exception occurs during writing, the writer should clean up useless files for the user.

Specified by:

write in interface FileWriter<T,R>

Overrides:

write in class SingleFileWriter<T,R>

Parameters:

record - to write.

Throws:

IOException - if encounter any IO error.

writeBundle

public void writeBundle(BundleRecords bundle)
                 throws IOException

Overrides:

writeBundle in class SingleFileWriter<T,R>

Throws:

IOException

fieldStats

public SimpleColStats[] fieldStats()
                            throws IOException

Throws:

IOException