org.apache.paimon.format.parquet

Class ParquetFileFormat

java.lang.Object

org.apache.paimon.format.FileFormat

org.apache.paimon.format.parquet.ParquetFileFormat

public class ParquetFileFormat
extends FileFormat

Parquet FileFormat.

Field Summary

Fields inherited from class org.apache.paimon.format.FileFormat

formatIdentifier

Constructor Summary

Constructors

Constructor and Description
ParquetFileFormat(FileFormatFactory.FormatContext formatContext)

Method Summary

Modifier and Type	Method and Description
FormatReaderFactory	createReaderFactory(RowType projectedRowType, List<Predicate> filters) Create a FormatReaderFactory from the type, with projection pushed down.
Optional<SimpleStatsExtractor>	createStatsExtractor(RowType type, SimpleColStatsCollector.Factory[] statsCollectors)
FormatWriterFactory	createWriterFactory(RowType type) Create a FormatWriterFactory from the type.
static Options	getParquetConfiguration(FileFormatFactory.FormatContext context)
void	validateDataFields(RowType rowType) Validate data field type supported or not.

Methods inherited from class org.apache.paimon.format.FileFormat

createReaderFactory, fromIdentifier, fromIdentifier, getFileFormat, getFormatIdentifier

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetFileFormat

public ParquetFileFormat(FileFormatFactory.FormatContext formatContext)

Method Detail

createReaderFactory

public FormatReaderFactory createReaderFactory(RowType projectedRowType,
                                               List<Predicate> filters)

Description copied from class: FileFormat

Create a FormatReaderFactory from the type, with projection pushed down.

Specified by:

createReaderFactory in class FileFormat

Parameters:

projectedRowType - Type with projection.

filters - A list of filters in conjunctive form for filtering on a best-effort basis.

createWriterFactory

public FormatWriterFactory createWriterFactory(RowType type)

Description copied from class: FileFormat

Create a FormatWriterFactory from the type.

Specified by:

createWriterFactory in class FileFormat

validateDataFields

public void validateDataFields(RowType rowType)

Description copied from class: FileFormat

Validate data field type supported or not.

Specified by:

validateDataFields in class FileFormat

createStatsExtractor

public Optional<SimpleStatsExtractor> createStatsExtractor(RowType type,
                                                           SimpleColStatsCollector.Factory[] statsCollectors)

Overrides:

createStatsExtractor in class FileFormat

getParquetConfiguration

public static Options getParquetConfiguration(FileFormatFactory.FormatContext context)