org.apache.paimon.format.parquet

Class ParquetUtil

java.lang.Object

org.apache.paimon.format.parquet.ParquetUtil

public class ParquetUtil
extends Object

Parquet utilities that support to extract the metadata, assert expected stats, etc.

Constructor Summary

Constructors

Constructor and Description
ParquetUtil()

Method Summary

Modifier and Type	Method and Description
static Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,SimpleStatsExtractor.FileInfo>	extractColumnStats(FileIO fileIO, Path path) Extract stats from specified Parquet files path.
static ParquetFileReader	getParquetReader(FileIO fileIO, Path path, FileIndexResult fileIndexResult) Generate ParquetFileReader instance to read the Parquet files at the given path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetUtil

public ParquetUtil()

Method Detail

extractColumnStats

public static Pair<Map<String,org.apache.parquet.column.statistics.Statistics<?>>,SimpleStatsExtractor.FileInfo> extractColumnStats(FileIO fileIO,
                                                                                                                                    Path path)
                                                                                                                             throws IOException

Extract stats from specified Parquet files path.

Parameters:

path - the path of parquet files to be read

Returns:

result sets as map, key is column name, value is statistics (for example, null count, minimum value, maximum value)

Throws:

IOException

getParquetReader

public static ParquetFileReader getParquetReader(FileIO fileIO,
                                                 Path path,
                                                 FileIndexResult fileIndexResult)
                                          throws IOException

Generate ParquetFileReader instance to read the Parquet files at the given path.

Parameters:

path - the path of parquet files to be read

Returns:

parquet reader, used for reading footer, status, etc.

Throws:

IOException