public class AvroFileFormat extends FileFormat
FileFormat
.Modifier and Type | Field and Description |
---|---|
static ConfigOption<String> |
AVRO_OUTPUT_CODEC |
static ConfigOption<Map<String,String>> |
AVRO_ROW_NAME_MAPPING |
static String |
IDENTIFIER |
formatIdentifier
Constructor and Description |
---|
AvroFileFormat(FileFormatFactory.FormatContext context) |
Modifier and Type | Method and Description |
---|---|
FormatReaderFactory |
createReaderFactory(RowType projectedRowType,
List<Predicate> filters)
Create a
FormatReaderFactory from the type, with projection pushed down. |
Optional<SimpleStatsExtractor> |
createStatsExtractor(RowType type,
SimpleColStatsCollector.Factory[] statsCollectors) |
FormatWriterFactory |
createWriterFactory(RowType type)
Create a
FormatWriterFactory from the type. |
void |
validateDataFields(RowType rowType)
Validate data field type supported or not.
|
createReaderFactory, fromIdentifier, fromIdentifier, getFileFormat, getFormatIdentifier
public static final String IDENTIFIER
public static final ConfigOption<String> AVRO_OUTPUT_CODEC
public static final ConfigOption<Map<String,String>> AVRO_ROW_NAME_MAPPING
public AvroFileFormat(FileFormatFactory.FormatContext context)
public FormatReaderFactory createReaderFactory(RowType projectedRowType, @Nullable List<Predicate> filters)
FileFormat
FormatReaderFactory
from the type, with projection pushed down.createReaderFactory
in class FileFormat
projectedRowType
- Type with projection.filters
- A list of filters in conjunctive form for filtering on a best-effort basis.public FormatWriterFactory createWriterFactory(RowType type)
FileFormat
FormatWriterFactory
from the type.createWriterFactory
in class FileFormat
public Optional<SimpleStatsExtractor> createStatsExtractor(RowType type, SimpleColStatsCollector.Factory[] statsCollectors)
createStatsExtractor
in class FileFormat
public void validateDataFields(RowType rowType)
FileFormat
validateDataFields
in class FileFormat
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.