org.apache.paimon.format.orc.writer

Class OrcBulkWriter

java.lang.Object

org.apache.paimon.format.orc.writer.OrcBulkWriter

All Implemented Interfaces:

Closeable, AutoCloseable, FormatWriter

public class OrcBulkWriter
extends Object
implements FormatWriter

A FormatWriter implementation that writes data in ORC format.

Constructor Summary

Constructors

Constructor and Description
OrcBulkWriter(Vectorizer<InternalRow> vectorizer, org.apache.orc.Writer writer, PositionOutputStream underlyingStream, int batchSize)

Method Summary

Modifier and Type	Method and Description
void	addElement(InternalRow element) Adds an element to the encoder.
void	close()
boolean	reachTargetSize(boolean suggestedCheck, long targetSize) Check if the writer has reached the targetSize.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OrcBulkWriter

public OrcBulkWriter(Vectorizer<InternalRow> vectorizer,
                     org.apache.orc.Writer writer,
                     PositionOutputStream underlyingStream,
                     int batchSize)

Method Detail

addElement

public void addElement(InternalRow element)
                throws IOException

Description copied from interface: FormatWriter

Adds an element to the encoder. The encoder may temporarily buffer the element, or immediately write it to the stream.

It may be that adding this element fills up an internal buffer and causes the encoding and flushing of a batch of internally buffered elements.

Specified by:

addElement in interface FormatWriter

Parameters:

element - The element to add.

Throws:

IOException - Thrown, if the element cannot be added to the encoder, or if the output stream throws an exception.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

reachTargetSize

public boolean reachTargetSize(boolean suggestedCheck,
                               long targetSize)
                        throws IOException

Description copied from interface: FormatWriter

Check if the writer has reached the targetSize.

Specified by:

reachTargetSize in interface FormatWriter

Parameters:

suggestedCheck - Whether it needs to be checked, but subclasses can also decide whether to check it themselves.

targetSize - The size of the target.

Returns:

true if the target size was reached, otherwise false.

Throws:

IOException - Thrown if calculating the length fails.