Modifier and Type | Class and Description |
---|---|
class |
AbstractArrayBasedVector
Abstract class for vectors that have offsets and lengths.
|
class |
AbstractHeapVector
Heap vector that nullable shared structure.
|
class |
AbstractStructVector
Abstract class for vectors that have children.
|
class |
HeapArrayVector
This class represents a nullable heap array column vector.
|
class |
HeapBooleanVector
This class represents a nullable heap boolean column vector.
|
class |
HeapBytesVector
This class supports string and binary data by value reference -- i.e.
|
class |
HeapByteVector
This class represents a nullable byte column vector.
|
class |
HeapDoubleVector
This class represents a nullable double precision floating point column vector.
|
class |
HeapFloatVector
This class represents a nullable double precision floating point column vector.
|
class |
HeapIntVector
This class represents a nullable int column vector.
|
class |
HeapLongVector
This class represents a nullable long column vector.
|
class |
HeapMapVector
This class represents a nullable heap map column vector.
|
class |
HeapRowVector
This class represents a nullable heap row column vector.
|
class |
HeapShortVector
This class represents a nullable short column vector.
|
class |
HeapTimestampVector
This class represents a nullable byte column vector.
|
Modifier and Type | Method and Description |
---|---|
void |
HeapRowVector.setFields(WritableColumnVector[] fields) |
Modifier and Type | Interface and Description |
---|---|
interface |
WritableBooleanVector
Writable
BooleanColumnVector . |
interface |
WritableBytesVector
Writable
BytesColumnVector . |
interface |
WritableByteVector
Writable
ByteColumnVector . |
interface |
WritableDoubleVector
Writable
DoubleColumnVector . |
interface |
WritableFloatVector
Writable
FloatColumnVector . |
interface |
WritableIntVector
Writable
IntColumnVector . |
interface |
WritableLongVector
Writable
LongColumnVector . |
interface |
WritableShortVector
Writable
ShortColumnVector . |
interface |
WritableTimestampVector
Writable
TimestampColumnVector . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractWritableVector
Contains the shared structure for
ColumnVector s, including NULL information and
dictionary. |
Modifier and Type | Interface and Description |
---|---|
interface |
ParquetVectorUpdater<T extends WritableColumnVector>
Interface to update a vector with values read from a Parquet file.
|
Modifier and Type | Method and Description |
---|---|
void |
VectorizedRleValuesReader.readBatch(ParquetReadState state,
WritableColumnVector values,
WritableIntVector defLevels,
VectorizedValuesReader valueReader,
ParquetVectorUpdater updater)
Reads a batch of definition levels and values into vector 'defLevels' and 'values'
respectively.
|
void |
VectorizedRleValuesReader.readBatchRepeated(ParquetReadState state,
WritableIntVector repLevels,
VectorizedRleValuesReader defLevelsReader,
WritableIntVector defLevels,
WritableColumnVector values,
VectorizedValuesReader valueReader,
ParquetVectorUpdater updater)
Reads a batch of repetition levels, definition levels and values into 'repLevels',
'defLevels' and 'values' respectively.
|
void |
VectorizedRleValuesReader.readBatchRepeatedInternal(ParquetReadState state,
WritableIntVector repLevels,
VectorizedRleValuesReader defLevelsReader,
WritableIntVector defLevels,
WritableColumnVector values,
WritableColumnVector nulls,
boolean valuesReused,
VectorizedValuesReader valueReader,
ParquetVectorUpdater updater)
Keep reading repetition level values from the page until either: 1) we've read enough
top-level rows to fill the current batch, or 2) we've drained the data page completely.
|
void |
VectorizedRleValuesReader.readIntegers(ParquetReadState state,
WritableColumnVector values,
WritableColumnVector nulls,
WritableIntVector defLevels,
VectorizedValuesReader valueReader)
Decoding for dictionary ids.
|
void |
VectorizedRleValuesReader.readIntegersRepeated(ParquetReadState state,
WritableIntVector repLevels,
VectorizedRleValuesReader defLevelsReader,
WritableIntVector defLevels,
WritableColumnVector values,
WritableColumnVector nulls,
VectorizedValuesReader valueReader)
Reads a batch of repetition levels, definition levels and integer values into 'repLevels',
'defLevels', 'values' and 'nulls' respectively.
|
void |
VectorizedValuesReader.IntegerOutputWriter.write(WritableColumnVector outputColumnVector,
int rowId,
long val)
A functional interface that writes a long value to a specified row in an output column
vector.
|
Constructor and Description |
---|
VectorizedParquetRecordReader(Path filePath,
ParquetFileReader reader,
org.apache.parquet.schema.MessageType fileSchema,
List<ParquetField> fields,
WritableColumnVector[] vectors,
int batchSize) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractColumnReader<VECTOR extends WritableColumnVector>
Abstract
ColumnReader . |
interface |
ColumnReader<VECTOR extends WritableColumnVector>
Read a batch of records for a column to
WritableColumnVector from parquet data file. |
class |
FixedLenBytesBinaryColumnReader<VECTOR extends WritableColumnVector>
Fixed length bytes
ColumnReader , just for Binary. |
class |
FixedLenBytesColumnReader<VECTOR extends WritableColumnVector>
Fixed length bytes
ColumnReader , just for Decimal. |
class |
FixedLenBytesDecimalColumnReader<VECTOR extends WritableColumnVector>
Fixed length bytes
ColumnReader , just for Decimal. |
Modifier and Type | Class and Description |
---|---|
class |
ParquetDecimalVector
Parquet write decimal as int32 and int64 and binary, this class wrap the real vector to provide
DecimalColumnVector interface. |
Modifier and Type | Method and Description |
---|---|
static WritableColumnVector |
ParquetSplitReaderUtil.createWritableColumnVector(int batchSize,
DataType fieldType,
org.apache.parquet.schema.Type type,
List<org.apache.parquet.column.ColumnDescriptor> columnDescriptors,
int depth) |
WritableColumnVector |
NestedPrimitiveColumnReader.readAndNewVector(int readNumber,
WritableColumnVector vector) |
Modifier and Type | Method and Description |
---|---|
WritableColumnVector |
NestedPrimitiveColumnReader.readAndNewVector(int readNumber,
WritableColumnVector vector) |
void |
NestedColumnReader.readToVector(int readNumber,
WritableColumnVector vector) |
void |
RowColumnReader.readToVector(int readNumber,
WritableColumnVector vector) |
void |
NestedPrimitiveColumnReader.readToVector(int readNumber,
WritableColumnVector vector) |
Constructor and Description |
---|
ParquetDecimalVector(WritableColumnVector vector) |
Copyright © 2023–2025 The Apache Software Foundation. All rights reserved.