org.apache.paimon.spark

Class SparkInternalRowWrapper

java.lang.Object

org.apache.paimon.spark.SparkInternalRowWrapper

All Implemented Interfaces:

DataGetters, InternalRow

public class SparkInternalRowWrapper
extends Object
implements InternalRow

Wrapper to fetch value from the spark internal row.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SparkInternalRowWrapper.SparkInternalArray adapt to spark internal array.
static class	SparkInternalRowWrapper.SparkInternalMap adapt to spark internal map.

Nested classes/interfaces inherited from interface org.apache.paimon.data.InternalRow

InternalRow.FieldGetter, InternalRow.FieldSetter

Constructor Summary

Constructors

Constructor and Description
SparkInternalRowWrapper(org.apache.spark.sql.catalyst.InternalRow internalRow, int rowKindIdx, org.apache.spark.sql.types.StructType structType, int length)
SparkInternalRowWrapper(int rowKindIdx, org.apache.spark.sql.types.StructType structType, int length)

Method Summary

Modifier and Type	Method and Description
InternalArray	getArray(int pos) Returns the array value at the given position.
byte[]	getBinary(int pos) Returns the binary value at the given position.
boolean	getBoolean(int pos) Returns the boolean value at the given position.
byte	getByte(int pos) Returns the byte value at the given position.
Decimal	getDecimal(int pos, int precision, int scale) Returns the decimal value at the given position.
double	getDouble(int pos) Returns the double value at the given position.
int	getFieldCount() Returns the number of fields in this row.
float	getFloat(int pos) Returns the float value at the given position.
int	getInt(int pos) Returns the integer value at the given position.
long	getLong(int pos) Returns the long value at the given position.
InternalMap	getMap(int pos) Returns the map value at the given position.
InternalRow	getRow(int pos, int numFields) Returns the row value at the given position.
RowKind	getRowKind() Returns the kind of change that this row describes in a changelog.
short	getShort(int pos) Returns the short value at the given position.
BinaryString	getString(int pos) Returns the string value at the given position.
Timestamp	getTimestamp(int pos, int precision) Returns the timestamp value at the given position.
Variant	getVariant(int pos) Returns the variant value at the given position.
boolean	isNullAt(int pos) Returns true if the element is null at the given position.
SparkInternalRowWrapper	replace(org.apache.spark.sql.catalyst.InternalRow internalRow)
void	setRowKind(RowKind kind) Sets the kind of change that this row describes in a changelog.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.data.InternalRow

createFieldGetter, createFieldSetter, getDataClass

Constructor Detail

SparkInternalRowWrapper

public SparkInternalRowWrapper(org.apache.spark.sql.catalyst.InternalRow internalRow,
                               int rowKindIdx,
                               org.apache.spark.sql.types.StructType structType,
                               int length)

SparkInternalRowWrapper

public SparkInternalRowWrapper(int rowKindIdx,
                               org.apache.spark.sql.types.StructType structType,
                               int length)

Method Detail

replace

public SparkInternalRowWrapper replace(org.apache.spark.sql.catalyst.InternalRow internalRow)

getFieldCount

public int getFieldCount()

Description copied from interface: InternalRow

Returns the number of fields in this row.

The number does not include RowKind. It is kept separately.

Specified by:

getFieldCount in interface InternalRow

getRowKind

public RowKind getRowKind()

Description copied from interface: InternalRow

Returns the kind of change that this row describes in a changelog.

Specified by:

getRowKind in interface InternalRow

See Also:

RowKind

setRowKind

public void setRowKind(RowKind kind)

Description copied from interface: InternalRow

Sets the kind of change that this row describes in a changelog.

Specified by:

setRowKind in interface InternalRow

See Also:

RowKind

isNullAt

public boolean isNullAt(int pos)

Description copied from interface: DataGetters

Returns true if the element is null at the given position.

Specified by:

isNullAt in interface DataGetters

getBoolean

public boolean getBoolean(int pos)

Description copied from interface: DataGetters

Returns the boolean value at the given position.

Specified by:

getBoolean in interface DataGetters

getByte

public byte getByte(int pos)

Description copied from interface: DataGetters

Returns the byte value at the given position.

Specified by:

getByte in interface DataGetters

getShort

public short getShort(int pos)

Description copied from interface: DataGetters

Returns the short value at the given position.

Specified by:

getShort in interface DataGetters

getInt

public int getInt(int pos)

Description copied from interface: DataGetters

Returns the integer value at the given position.

Specified by:

getInt in interface DataGetters

getLong

public long getLong(int pos)

Description copied from interface: DataGetters

Returns the long value at the given position.

Specified by:

getLong in interface DataGetters

getFloat

public float getFloat(int pos)

Description copied from interface: DataGetters

Returns the float value at the given position.

Specified by:

getFloat in interface DataGetters

getDouble

public double getDouble(int pos)

Description copied from interface: DataGetters

Returns the double value at the given position.

Specified by:

getDouble in interface DataGetters

getString

public BinaryString getString(int pos)

Description copied from interface: DataGetters

Returns the string value at the given position.

Specified by:

getString in interface DataGetters

getDecimal

public Decimal getDecimal(int pos,
                          int precision,
                          int scale)

Description copied from interface: DataGetters

Returns the decimal value at the given position.

The precision and scale are required to determine whether the decimal value was stored in a compact representation (see Decimal).

Specified by:

getDecimal in interface DataGetters

getTimestamp

public Timestamp getTimestamp(int pos,
                              int precision)

Description copied from interface: DataGetters

Returns the timestamp value at the given position.

The precision is required to determine whether the timestamp value was stored in a compact representation (see Timestamp).

Specified by:

getTimestamp in interface DataGetters

getBinary

public byte[] getBinary(int pos)

Description copied from interface: DataGetters

Returns the binary value at the given position.

Specified by:

getBinary in interface DataGetters

getVariant

public Variant getVariant(int pos)

Description copied from interface: DataGetters

Returns the variant value at the given position.

Specified by:

getVariant in interface DataGetters

getArray

public InternalArray getArray(int pos)

Description copied from interface: DataGetters

Returns the array value at the given position.

Specified by:

getArray in interface DataGetters

getMap

public InternalMap getMap(int pos)

Description copied from interface: DataGetters

Returns the map value at the given position.

Specified by:

getMap in interface DataGetters

getRow

public InternalRow getRow(int pos,
                          int numFields)

Description copied from interface: DataGetters

Returns the row value at the given position.

The number of fields is required to correctly extract the row.

Specified by:

getRow in interface DataGetters