org.apache.paimon.format.parquet

Class ParquetUtil

java.lang.Object

org.apache.paimon.format.parquet.ParquetUtil

public class ParquetUtil
extends Object

Parquet utilities that support to extract the metadata, assert expected stats, etc.

Constructor Summary

Constructors

Constructor and Description
ParquetUtil()

Method Summary

Modifier and Type	Method and Description
static Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,SimpleStatsExtractor.FileInfo>	extractColumnStats(FileIO fileIO, Path path, long length) Extract stats from specified Parquet file path.
static ParquetFileReader	getParquetReader(FileIO fileIO, Path path, long length) Generate ParquetFileReader instance to read the Parquet file at the given path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetUtil

public ParquetUtil()

Method Detail

extractColumnStats

public static Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,SimpleStatsExtractor.FileInfo> extractColumnStats(FileIO fileIO,
                                                                                                                                    Path path,
                                                                                                                                    long length)
                                                                                                                             throws IOException

Extract stats from specified Parquet file path.

Parameters:

path - the path of parquet file to be read

length - the length of parquet file to be read

Returns:

result sets as map, key is column name, value is statistics (for example, null count, minimum value, maximum value)

Throws:

IOException

getParquetReader

public static ParquetFileReader getParquetReader(FileIO fileIO,
                                                 Path path,
                                                 long length)
                                          throws IOException

Generate ParquetFileReader instance to read the Parquet file at the given path.

Parameters:

path - the path of parquet file to be read

length - the length of parquet file to be read

Returns:

parquet reader, used for reading footer, status, etc.

Throws:

IOException