org.apache.paimon.format.parquet.writer

Class ParquetBulkWriter

java.lang.Object

org.apache.paimon.format.parquet.writer.ParquetBulkWriter

All Implemented Interfaces:

Closeable, AutoCloseable, FormatWriter

public class ParquetBulkWriter
extends Object
implements FormatWriter

A simple FormatWriter implementation that wraps a ParquetWriter.

Constructor Summary

Constructors

Constructor and Description
ParquetBulkWriter(ParquetWriter<InternalRow> parquetWriter) Creates a new ParquetBulkWriter wrapping the given ParquetWriter.

Method Summary

Modifier and Type	Method and Description
void	addElement(InternalRow datum) Adds an element to the encoder.
void	close()
boolean	reachTargetSize(boolean suggestedCheck, long targetSize) Check if the writer has reached the targetSize.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetBulkWriter

public ParquetBulkWriter(ParquetWriter<InternalRow> parquetWriter)

Creates a new ParquetBulkWriter wrapping the given ParquetWriter.

Parameters:

parquetWriter - The ParquetWriter to write to.

Method Detail

addElement

public void addElement(InternalRow datum)
                throws IOException

Description copied from interface: FormatWriter

Adds an element to the encoder. The encoder may temporarily buffer the element, or immediately write it to the stream.

It may be that adding this element fills up an internal buffer and causes the encoding and flushing of a batch of internally buffered elements.

Specified by:

addElement in interface FormatWriter

Parameters:

datum - The element to add.

Throws:

IOException - Thrown, if the element cannot be added to the encoder, or if the output stream throws an exception.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

reachTargetSize

public boolean reachTargetSize(boolean suggestedCheck,
                               long targetSize)
                        throws IOException

Description copied from interface: FormatWriter

Check if the writer has reached the targetSize.

Specified by:

reachTargetSize in interface FormatWriter

Parameters:

suggestedCheck - Whether it needs to be checked, but subclasses can also decide whether to check it themselves.

targetSize - The size of the target.

Returns:

true if the target size was reached, otherwise false.

Throws:

IOException - Thrown if calculating the length fails.