Package | Description |
---|---|
org.apache.paimon.data.columnar.heap | |
org.apache.paimon.data.columnar.writable | |
org.apache.paimon.format.parquet.reader |
Modifier and Type | Class and Description |
---|---|
class |
AbstractArrayBasedVector
Abstract class for vectors that have offsets and lengths.
|
class |
AbstractHeapVector
Heap vector that nullable shared structure.
|
class |
AbstractStructVector
Abstract class for vectors that have children.
|
class |
HeapArrayVector
This class represents a nullable heap array column vector.
|
class |
HeapBooleanVector
This class represents a nullable heap boolean column vector.
|
class |
HeapBytesVector
This class supports string and binary data by value reference -- i.e.
|
class |
HeapByteVector
This class represents a nullable byte column vector.
|
class |
HeapDoubleVector
This class represents a nullable double precision floating point column vector.
|
class |
HeapFloatVector
This class represents a nullable double precision floating point column vector.
|
class |
HeapIntVector
This class represents a nullable int column vector.
|
class |
HeapLongVector
This class represents a nullable long column vector.
|
class |
HeapMapVector
This class represents a nullable heap map column vector.
|
class |
HeapRowVector
This class represents a nullable heap row column vector.
|
class |
HeapShortVector
This class represents a nullable short column vector.
|
class |
HeapTimestampVector
This class represents a nullable byte column vector.
|
Modifier and Type | Method and Description |
---|---|
void |
HeapRowVector.setFields(WritableColumnVector[] fields) |
Modifier and Type | Interface and Description |
---|---|
interface |
WritableBooleanVector
Writable
BooleanColumnVector . |
interface |
WritableBytesVector
Writable
BytesColumnVector . |
interface |
WritableByteVector
Writable
ByteColumnVector . |
interface |
WritableDoubleVector
Writable
DoubleColumnVector . |
interface |
WritableFloatVector
Writable
FloatColumnVector . |
interface |
WritableIntVector
Writable
IntColumnVector . |
interface |
WritableLongVector
Writable
LongColumnVector . |
interface |
WritableShortVector
Writable
ShortColumnVector . |
interface |
WritableTimestampVector
Writable
TimestampColumnVector . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractWritableVector
Contains the shared structure for
ColumnVector s, including NULL information and
dictionary. |
Modifier and Type | Interface and Description |
---|---|
interface |
ParquetVectorUpdater<T extends WritableColumnVector>
Interface to update a vector with values read from a Parquet file.
|
Modifier and Type | Class and Description |
---|---|
class |
ParquetDecimalVector
Parquet write decimal as int32 and int64 and binary, this class wrap the real vector to provide
DecimalColumnVector interface. |
Modifier and Type | Method and Description |
---|---|
static WritableColumnVector |
ParquetSplitReaderUtil.createWritableColumnVector(int batchSize,
DataType fieldType,
org.apache.parquet.schema.Type type,
List<org.apache.parquet.column.ColumnDescriptor> columnDescriptors,
int depth) |
Modifier and Type | Method and Description |
---|---|
void |
VectorizedRleValuesReader.readBatch(ParquetReadState state,
WritableColumnVector values,
WritableIntVector defLevels,
VectorizedValuesReader valueReader,
ParquetVectorUpdater updater)
Reads a batch of definition levels and values into vector 'defLevels' and 'values'
respectively.
|
void |
VectorizedRleValuesReader.readBatchRepeated(ParquetReadState state,
WritableIntVector repLevels,
VectorizedRleValuesReader defLevelsReader,
WritableIntVector defLevels,
WritableColumnVector values,
VectorizedValuesReader valueReader,
ParquetVectorUpdater updater)
Reads a batch of repetition levels, definition levels and values into 'repLevels',
'defLevels' and 'values' respectively.
|
void |
VectorizedRleValuesReader.readBatchRepeatedInternal(ParquetReadState state,
WritableIntVector repLevels,
VectorizedRleValuesReader defLevelsReader,
WritableIntVector defLevels,
WritableColumnVector values,
WritableColumnVector nulls,
boolean valuesReused,
VectorizedValuesReader valueReader,
ParquetVectorUpdater updater)
Keep reading repetition level values from the page until either: 1) we've read enough
top-level rows to fill the current batch, or 2) we've drained the data page completely.
|
void |
VectorizedRleValuesReader.readIntegers(ParquetReadState state,
WritableColumnVector values,
WritableColumnVector nulls,
WritableIntVector defLevels,
VectorizedValuesReader valueReader)
Decoding for dictionary ids.
|
void |
VectorizedRleValuesReader.readIntegersRepeated(ParquetReadState state,
WritableIntVector repLevels,
VectorizedRleValuesReader defLevelsReader,
WritableIntVector defLevels,
WritableColumnVector values,
WritableColumnVector nulls,
VectorizedValuesReader valueReader)
Reads a batch of repetition levels, definition levels and integer values into 'repLevels',
'defLevels', 'values' and 'nulls' respectively.
|
void |
VectorizedValuesReader.IntegerOutputWriter.write(WritableColumnVector outputColumnVector,
int rowId,
long val)
A functional interface that writes a long value to a specified row in an output column
vector.
|
Constructor and Description |
---|
ParquetDecimalVector(WritableColumnVector vector) |
VectorizedParquetRecordReader(Path filePath,
ParquetFileReader reader,
org.apache.parquet.schema.MessageType fileSchema,
List<ParquetField> fields,
WritableColumnVector[] vectors,
int batchSize) |
Copyright © 2023–2025 The Apache Software Foundation. All rights reserved.