org.apache.paimon.format.parquet.newreader

Interface ParquetVectorUpdater<T extends WritableColumnVector>

Type Parameters:

T - type of the vector to update

public interface ParquetVectorUpdater<T extends WritableColumnVector>

Interface to update a vector with values read from a Parquet file.

Method Summary

Modifier and Type	Method and Description
default void	decodeDictionaryIds(int total, int offset, T values, WritableIntVector dictionaryIds, org.apache.parquet.column.Dictionary dictionary) Process a batch of `total` values starting from `offset` in `values`, whose null slots should have already been filled, and fills the non-null slots using dictionary IDs from `dictionaryIds`, together with Parquet `dictionary`.
void	decodeSingleDictionaryId(int offset, T values, WritableIntVector dictionaryIds, org.apache.parquet.column.Dictionary dictionary) Decode a single dictionary ID from `dictionaryIds` into `values` at `offset`, using `dictionary`.
void	readValue(int offset, T values, VectorizedValuesReader valuesReader) Read a single value from `valuesReader` into `values`, at `offset`.
void	readValues(int total, int offset, T values, VectorizedValuesReader valuesReader) Read a batch of `total` values from `valuesReader` into `values`, starting from `offset`.
void	skipValues(int total, VectorizedValuesReader valuesReader) Skip a batch of `total` values from `valuesReader`.

Method Detail

readValues

void readValues(int total,
                int offset,
                T values,
                VectorizedValuesReader valuesReader)

Read a batch of `total` values from `valuesReader` into `values`, starting from `offset`.

Parameters:

total - total number of values to read

offset - starting offset in `values`

values - destination values vector

valuesReader - reader to read values from

skipValues

void skipValues(int total,
                VectorizedValuesReader valuesReader)

Skip a batch of `total` values from `valuesReader`.

Parameters:

total - total number of values to skip

valuesReader - reader to skip values from

readValue

void readValue(int offset,
               T values,
               VectorizedValuesReader valuesReader)

Read a single value from `valuesReader` into `values`, at `offset`.

Parameters:

offset - offset in `values` to put the new value

values - destination value vector

valuesReader - reader to read values from

decodeDictionaryIds

default void decodeDictionaryIds(int total,
                                 int offset,
                                 T values,
                                 WritableIntVector dictionaryIds,
                                 org.apache.parquet.column.Dictionary dictionary)

Process a batch of `total` values starting from `offset` in `values`, whose null slots should have already been filled, and fills the non-null slots using dictionary IDs from `dictionaryIds`, together with Parquet `dictionary`.

Parameters:

total - total number slots to process in `values`

offset - starting offset in `values`

values - destination value vector

dictionaryIds - vector storing the dictionary IDs

dictionary - Parquet dictionary used to decode a dictionary ID to its value

decodeSingleDictionaryId

void decodeSingleDictionaryId(int offset,
                              T values,
                              WritableIntVector dictionaryIds,
                              org.apache.parquet.column.Dictionary dictionary)

Decode a single dictionary ID from `dictionaryIds` into `values` at `offset`, using `dictionary`.

Parameters:

offset - offset in `values` to put the decoded value

values - destination value vector

dictionaryIds - vector storing the dictionary IDs

dictionary - Parquet dictionary used to decode a dictionary ID to its value