org.apache.paimon.format.parquet

Class ParquetSchemaConverter

java.lang.Object

org.apache.paimon.format.parquet.ParquetSchemaConverter

public class ParquetSchemaConverter
extends Object

Schema converter converts Parquet schema to and from Paimon internal types.

Field Summary

Fields

Modifier and Type	Field and Description
static String	LIST_ELEMENT_NAME
static String	MAP_KEY_NAME
static String	MAP_REPEATED_NAME
static String	MAP_VALUE_NAME
static String	PAIMON_SCHEMA

Constructor Summary

Constructors

Constructor and Description
ParquetSchemaConverter()

Method Summary

Modifier and Type	Method and Description
static int	computeMinBytesForDecimalPrecision(int precision)
static DataField	convertToPaimonField(org.apache.parquet.schema.Type parquetType) Convert parquet Type to paimon DataField to.
static RowType	convertToPaimonRowType(org.apache.parquet.schema.MessageType messageType) Convert parquet MessageType to paimon RowType.
static org.apache.parquet.schema.MessageType	convertToParquetMessageType(RowType rowType) Convert paimon RowType to parquet MessageType.
static org.apache.parquet.schema.Type	convertToParquetType(DataField field) Convert paimon DataField to parquet Type.
static org.apache.parquet.schema.Type	convertToParquetType(String name, DataType type, int fieldId, int depth)
static org.apache.parquet.schema.Type[]	convertToParquetTypes(RowType rowType)
static org.apache.parquet.schema.Type	createTimestampWithLogicalType(String name, int precision, org.apache.parquet.schema.Type.Repetition repetition, boolean isAdjustToUTC)
static boolean	is32BitDecimal(int precision)
static boolean	is64BitDecimal(int precision)
static org.apache.parquet.schema.Type	parquetListElementType(org.apache.parquet.schema.GroupType listType, int level)
static Pair<org.apache.parquet.schema.Type,org.apache.parquet.schema.Type>	parquetMapKeyValueType(org.apache.parquet.schema.GroupType mapType)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PAIMON_SCHEMA

public static final String PAIMON_SCHEMA

See Also:

Constant Field Values

MAP_REPEATED_NAME

public static final String MAP_REPEATED_NAME

See Also:

Constant Field Values

MAP_KEY_NAME

public static final String MAP_KEY_NAME

See Also:

Constant Field Values

MAP_VALUE_NAME

public static final String MAP_VALUE_NAME

See Also:

Constant Field Values

LIST_ELEMENT_NAME

public static final String LIST_ELEMENT_NAME

See Also:

Constant Field Values

Constructor Detail

ParquetSchemaConverter

public ParquetSchemaConverter()

Method Detail

convertToParquetMessageType

public static org.apache.parquet.schema.MessageType convertToParquetMessageType(RowType rowType)

Convert paimon RowType to parquet MessageType.

convertToParquetTypes

public static org.apache.parquet.schema.Type[] convertToParquetTypes(RowType rowType)

convertToParquetType

public static org.apache.parquet.schema.Type convertToParquetType(DataField field)

Convert paimon DataField to parquet Type.

convertToParquetType

public static org.apache.parquet.schema.Type convertToParquetType(String name,
                                                                  DataType type,
                                                                  int fieldId,
                                                                  int depth)

createTimestampWithLogicalType

public static org.apache.parquet.schema.Type createTimestampWithLogicalType(String name,
                                                                            int precision,
                                                                            org.apache.parquet.schema.Type.Repetition repetition,
                                                                            boolean isAdjustToUTC)

computeMinBytesForDecimalPrecision

public static int computeMinBytesForDecimalPrecision(int precision)

is32BitDecimal

public static boolean is32BitDecimal(int precision)

is64BitDecimal

public static boolean is64BitDecimal(int precision)

convertToPaimonRowType

public static RowType convertToPaimonRowType(org.apache.parquet.schema.MessageType messageType)

Convert parquet MessageType to paimon RowType.

convertToPaimonField

public static DataField convertToPaimonField(org.apache.parquet.schema.Type parquetType)

Convert parquet Type to paimon DataField to.

parquetListElementType

public static org.apache.parquet.schema.Type parquetListElementType(org.apache.parquet.schema.GroupType listType,
                                                                    int level)

parquetMapKeyValueType

public static Pair<org.apache.parquet.schema.Type,org.apache.parquet.schema.Type> parquetMapKeyValueType(org.apache.parquet.schema.GroupType mapType)