org.apache.paimon.data.serializer

Interface PagedTypeSerializer<T>

All Superinterfaces:

Serializable, Serializer<T>

All Known Implementing Classes:

AbstractRowDataSerializer, BinaryRowSerializer, InternalRowSerializer

public interface PagedTypeSerializer<T>
extends Serializer<T>

A type serializer which provides paged serialize and deserialize methods.

Method Summary

Modifier and Type	Method and Description
T	deserializeFromPages(AbstractPagedInputView source) De-serializes a record from the given source paged input view.
T	deserializeFromPages(T reuse, AbstractPagedInputView source) Reuse version of deserializeFromPages(AbstractPagedInputView).
T	mapFromPages(T reuse, AbstractPagedInputView source) Map a reused record from the given source paged input view.
int	serializeToPages(T record, AbstractPagedOutputView target) Serializes the given record to the given target paged output view.
void	skipRecordFromPages(AbstractPagedInputView source) Skip over bytes of one record from the paged input view, discarding the skipped bytes.

Methods inherited from interface org.apache.paimon.data.serializer.Serializer

copy, deserialize, deserializeFromString, duplicate, serialize, serializeToString

Method Detail

serializeToPages

int serializeToPages(T record,
                     AbstractPagedOutputView target)
              throws IOException

Serializes the given record to the given target paged output view. Some implementations may skip some bytes if current page does not have enough space left, .e.g BinaryRow.

Parameters:

record - The record to serialize.

target - The output view to write the serialized data to.

Returns:

Returns the skipped number of bytes.

Throws:

IOException - Thrown, if the serialization encountered an I/O related error. Typically raised by the output view, which may have an underlying I/O channel to which it delegates.

deserializeFromPages

T deserializeFromPages(AbstractPagedInputView source)
                throws IOException

De-serializes a record from the given source paged input view. For consistency with serialize format, some implementations may need to skip some bytes of source before de-serializing, .e.g BinaryRow. Typically, the content read from source should be copied out when de-serializing, and we are not expecting the underlying data from source is reused. If you have such requirement, see #mapFromPages(T, AbstractPagedInputView).

Parameters:

source - The input view from which to read the data.

Returns:

The de-serialized element.

Throws:

IOException - Thrown, if the de-serialization encountered an I/O related error. Typically raised by the input view, which may have an underlying I/O channel from which it reads.

deserializeFromPages

T deserializeFromPages(T reuse,
                       AbstractPagedInputView source)
                throws IOException

Reuse version of deserializeFromPages(AbstractPagedInputView).

Throws:

IOException

mapFromPages

T mapFromPages(T reuse,
               AbstractPagedInputView source)
        throws IOException

Map a reused record from the given source paged input view. This method provides a possibility to achieve zero copy when de-serializing. You can either choose copy or not copy the content read from source, but we encourage to make it zero copy.

If you choose the zero copy way, you have to deal with the lifecycle of the pages properly.

Parameters:

reuse - the reused record to be mapped

source - The input view from which to read the data.

Returns:

The mapped record.

Throws:

IOException - Thrown, if the de-serialization encountered an I/O related error. Typically raised by the input view, which may have an underlying I/O channel from which it reads.

skipRecordFromPages

void skipRecordFromPages(AbstractPagedInputView source)
                  throws IOException

Skip over bytes of one record from the paged input view, discarding the skipped bytes.

Throws:

IOException