org.apache.paimon.format.orc

Class OrcFileFormat

java.lang.Object

org.apache.paimon.format.FileFormat

org.apache.paimon.format.orc.OrcFileFormat

@ThreadSafe
public class OrcFileFormat
extends FileFormat

Orc FileFormat.

Field Summary

Fields

Modifier and Type	Field and Description
static String	IDENTIFIER

Fields inherited from class org.apache.paimon.format.FileFormat

formatIdentifier

Constructor Summary

Constructors

Constructor and Description
OrcFileFormat(FileFormatFactory.FormatContext formatContext)

Method Summary

Modifier and Type	Method and Description
FormatReaderFactory	createReaderFactory(RowType projectedRowType, List<Predicate> filters) Create a FormatReaderFactory from the type, with projection pushed down.
Optional<SimpleStatsExtractor>	createStatsExtractor(RowType type, SimpleColStatsCollector.Factory[] statsCollectors)
FormatWriterFactory	createWriterFactory(RowType type) The OrcWriterFactory will create ThreadLocalClassLoaderConfiguration from the input writer config to avoid classloader leaks.
Properties	orcProperties()
int	readBatchSize()
static DataType	refineDataType(DataType type)
void	validateDataFields(RowType rowType) Validate data field type supported or not.

Methods inherited from class org.apache.paimon.format.FileFormat

createReaderFactory, fromIdentifier, fromIdentifier, getFileFormat, getFormatIdentifier

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

IDENTIFIER

public static final String IDENTIFIER

See Also:

Constant Field Values

Constructor Detail

OrcFileFormat

public OrcFileFormat(FileFormatFactory.FormatContext formatContext)

Method Detail

orcProperties

@VisibleForTesting
public Properties orcProperties()

readBatchSize

@VisibleForTesting
public int readBatchSize()

createStatsExtractor

public Optional<SimpleStatsExtractor> createStatsExtractor(RowType type,
                                                           SimpleColStatsCollector.Factory[] statsCollectors)

Overrides:

createStatsExtractor in class FileFormat

createReaderFactory

public FormatReaderFactory createReaderFactory(RowType projectedRowType,
                                               @Nullable
                                               List<Predicate> filters)

Description copied from class: FileFormat

Create a FormatReaderFactory from the type, with projection pushed down.

Specified by:

createReaderFactory in class FileFormat

Parameters:

projectedRowType - Type with projection.

filters - A list of filters in conjunctive form for filtering on a best-effort basis.

validateDataFields

public void validateDataFields(RowType rowType)

Description copied from class: FileFormat

Validate data field type supported or not.

Specified by:

validateDataFields in class FileFormat

createWriterFactory

public FormatWriterFactory createWriterFactory(RowType type)

The OrcWriterFactory will create ThreadLocalClassLoaderConfiguration from the input writer config to avoid classloader leaks.

TODO: The ThreadLocalClassLoaderConfiguration in OrcWriterFactory should be removed after https://issues.apache.org/jira/browse/ORC-653 is fixed.

Specified by:

createWriterFactory in class FileFormat

Parameters:

type - The data type for the writer

Returns:

The factory of the writer

refineDataType

public static DataType refineDataType(DataType type)