org.apache.paimon.format.parquet.newreader

Class VectorizedDeltaByteArrayReader

java.lang.Object

org.apache.parquet.column.values.ValuesReader

org.apache.paimon.format.parquet.newreader.VectorizedReaderBase

org.apache.paimon.format.parquet.newreader.VectorizedDeltaByteArrayReader

All Implemented Interfaces:

VectorizedValuesReader, org.apache.parquet.column.values.RequiresPreviousReader

public class VectorizedDeltaByteArrayReader
extends VectorizedReaderBase
implements VectorizedValuesReader, org.apache.parquet.column.values.RequiresPreviousReader

An implementation of the Parquet DELTA_BYTE_ARRAY decoder that supports the vectorized interface.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.paimon.format.parquet.newreader.VectorizedValuesReader

VectorizedValuesReader.ByteBufferOutputWriter, VectorizedValuesReader.IntegerOutputWriter

Method Summary

Modifier and Type	Method and Description
void	initFromPage(int valueCount, org.apache.parquet.bytes.ByteBufferInputStream in)
org.apache.parquet.io.api.Binary	readBinary(int len)
void	readBinary(int total, WritableBytesVector c, int rowId)
void	setPreviousReader(org.apache.parquet.column.values.ValuesReader reader) There was a bug (PARQUET-246) in which DeltaByteArrayWriter's reset() method did not clear the previous value state that it tracks internally.
void	skipBinary(int total)

Methods inherited from class org.apache.paimon.format.parquet.newreader.VectorizedReaderBase

readBooleans, readByte, readBytes, readDoubles, readFloats, readIntegers, readLongs, readShort, readShorts, skip, skipBooleans, skipBytes, skipDoubles, skipFixedLenByteArray, skipFloats, skipIntegers, skipLongs, skipShorts

Methods inherited from class org.apache.parquet.column.values.ValuesReader

getNextOffset, initFromPage, initFromPage, readBoolean, readBytes, readDouble, readFloat, readInteger, readLong, readValueDictionaryId, skip, updateNextOffset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.format.parquet.newreader.VectorizedValuesReader

readBoolean, readBooleans, readByte, readBytes, readDouble, readDoubles, readFloat, readFloats, readInteger, readIntegers, readLong, readLongs, readShort, readShorts, skipBooleans, skipBytes, skipDoubles, skipFixedLenByteArray, skipFloats, skipIntegers, skipLongs, skipShorts

Method Detail

initFromPage

public void initFromPage(int valueCount,
                         org.apache.parquet.bytes.ByteBufferInputStream in)
                  throws IOException

Overrides:

initFromPage in class org.apache.parquet.column.values.ValuesReader

Throws:

IOException

readBinary

public org.apache.parquet.io.api.Binary readBinary(int len)

Specified by:

readBinary in interface VectorizedValuesReader

Overrides:

readBinary in class VectorizedReaderBase

readBinary

public void readBinary(int total,
                       WritableBytesVector c,
                       int rowId)

Specified by:

readBinary in interface VectorizedValuesReader

Overrides:

readBinary in class VectorizedReaderBase

setPreviousReader

public void setPreviousReader(org.apache.parquet.column.values.ValuesReader reader)

There was a bug (PARQUET-246) in which DeltaByteArrayWriter's reset() method did not clear the previous value state that it tracks internally. This resulted in the first value of all pages (except for the first page) to be a delta from the last value of the previous page. In order to read corrupted files written with this bug, when reading a new page we need to recover the previous page's last value to use it (if needed) to read the first value.

Specified by:

setPreviousReader in interface org.apache.parquet.column.values.RequiresPreviousReader

skipBinary

public void skipBinary(int total)

Specified by:

skipBinary in interface VectorizedValuesReader

Overrides:

skipBinary in class VectorizedReaderBase