org.apache.paimon.fs

Class AsyncPositionOutputStream

java.lang.Object

java.io.OutputStream

org.apache.paimon.fs.PositionOutputStream

org.apache.paimon.fs.AsyncPositionOutputStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable

public class AsyncPositionOutputStream
extends PositionOutputStream

A PositionOutputStream which uses a async thread to write data.

Field Summary

Fields

Modifier and Type	Field and Description
static int	AWAIT_TIMEOUT_SECONDS
static int	BUFFER_SIZE
static ExecutorService	EXECUTOR_SERVICE
static int	MAX_BUFFER

Constructor Summary

Constructors

Constructor and Description
AsyncPositionOutputStream(PositionOutputStream out)

Method Summary

Modifier and Type	Method and Description
void	close() Closes the output stream.
void	flush() Flushes the stream, writing any data currently buffered in stream implementation to the proper output stream.
long	getPos() Gets the position of the stream (non-negative), defined as the number of bytes from the beginning of the file to the current writing position.
void	write(byte[] b) Writes b.length bytes from the specified byte array to this output stream.
void	write(byte[] b, int off, int len) Writes len bytes from the specified byte array starting at offset off to this output stream.
void	write(int b)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

EXECUTOR_SERVICE

public static final ExecutorService EXECUTOR_SERVICE

AWAIT_TIMEOUT_SECONDS

public static final int AWAIT_TIMEOUT_SECONDS

See Also:

Constant Field Values

BUFFER_SIZE

public static final int BUFFER_SIZE

See Also:

Constant Field Values

MAX_BUFFER

public static final int MAX_BUFFER

See Also:

Constant Field Values

Constructor Detail

AsyncPositionOutputStream

public AsyncPositionOutputStream(PositionOutputStream out)

Method Detail

getPos

public long getPos()
            throws IOException

Description copied from class: PositionOutputStream

Gets the position of the stream (non-negative), defined as the number of bytes from the beginning of the file to the current writing position. The position corresponds to the zero-based index of the next byte that will be written.

This method must report accurately report the current position of the stream. Various components of the high-availability and recovery logic rely on the accurate

Specified by:

getPos in class PositionOutputStream

Returns:

The current position in the stream, defined as the number of bytes from the beginning of the file to the current writing position.

Throws:

IOException - Thrown if an I/O error occurs while obtaining the position from the stream implementation.

write

public void write(int b)
           throws IOException

Specified by:

write in class OutputStream

Throws:

IOException

write

public void write(byte[] b)
           throws IOException

Description copied from class: PositionOutputStream

Writes b.length bytes from the specified byte array to this output stream. The general contract for write(b) is that it should have exactly the same effect as the call write(b, 0, b.length).

Specified by:

write in class PositionOutputStream

Throws:

IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws IOException

Description copied from class: PositionOutputStream

Writes len bytes from the specified byte array starting at offset off to this output stream. The general contract for write(b, off, len) is that some of the bytes in the array b are written to the output stream in order; element b[off] is the first byte written and b[off+len-1] is the last byte written by this operation.

Specified by:

write in class PositionOutputStream

Throws:

IOException

flush

public void flush()
           throws IOException

Description copied from class: PositionOutputStream

Flushes the stream, writing any data currently buffered in stream implementation to the proper output stream. After this method has been called, the stream implementation must not hold onto any buffered data any more.

Implementation note: This overrides the method defined in OutputStream as abstract to force implementations of the PositionOutputStream to implement this method directly.

Specified by:

flush in interface Flushable

Specified by:

flush in class PositionOutputStream

Throws:

IOException - Thrown if an I/O error occurs while flushing the stream.

close

public void close()
           throws IOException

Description copied from class: PositionOutputStream

Closes the output stream. After this method returns, the implementation must guarantee that all data written to the stream is persistent/visible.

The above implies that the method must block until persistence can be guaranteed. For example for distributed replicated file systems, the method must block until the replication quorum has been reached. If the calling thread is interrupted in the process, it must fail with an IOException to indicate that persistence cannot be guaranteed.

If this method throws an exception, the data in the stream cannot be assumed to be persistent.

Implementation note: This overrides the method defined in OutputStream as abstract to force implementations of the PositionOutputStream to implement this method directly.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in class PositionOutputStream

Throws:

IOException - Thrown, if an error occurred while closing the stream or guaranteeing that the data is persistent.