org.apache.paimon.flink.source

Class DataTableSource

java.lang.Object

org.apache.paimon.flink.source.FlinkTableSource

org.apache.paimon.flink.source.BaseDataTableSource

org.apache.paimon.flink.source.DataTableSource

All Implemented Interfaces:

org.apache.flink.table.connector.source.abilities.SupportsAggregatePushDown, org.apache.flink.table.connector.source.abilities.SupportsDynamicFiltering, org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown, org.apache.flink.table.connector.source.abilities.SupportsLimitPushDown, SupportsLookupCustomShuffle, org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown, org.apache.flink.table.connector.source.abilities.SupportsStatisticReport, org.apache.flink.table.connector.source.abilities.SupportsWatermarkPushDown, org.apache.flink.table.connector.source.DynamicTableSource, org.apache.flink.table.connector.source.LookupTableSource, org.apache.flink.table.connector.source.ScanTableSource

public class DataTableSource
extends BaseDataTableSource
implements org.apache.flink.table.connector.source.abilities.SupportsStatisticReport, org.apache.flink.table.connector.source.abilities.SupportsDynamicFiltering

A BaseDataTableSource implements SupportsStatisticReport and SupportsDynamicFiltering.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.flink.source.FlinkTableSource

FlinkTableSource.SplitStatistics

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.LookupTableSource

org.apache.flink.table.connector.source.LookupTableSource.LookupContext, org.apache.flink.table.connector.source.LookupTableSource.LookupRuntimeProvider

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.DynamicTableSource

org.apache.flink.table.connector.source.DynamicTableSource.Context, org.apache.flink.table.connector.source.DynamicTableSource.DataStructureConverter

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.abilities.SupportsLookupCustomShuffle

SupportsLookupCustomShuffle.InputDataPartitioner

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.ScanTableSource

org.apache.flink.table.connector.source.ScanTableSource.ScanContext, org.apache.flink.table.connector.source.ScanTableSource.ScanRuntimeProvider

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown

org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown.Result

Field Summary

Fields inherited from class org.apache.paimon.flink.source.BaseDataTableSource

context, countPushed, logStoreTableFactory, tableIdentifier, unbounded, watermarkStrategy

Fields inherited from class org.apache.paimon.flink.source.FlinkTableSource

FLINK_INFER_SCAN_PARALLELISM, limit, options, predicate, projectFields, splitStatistics, table

Constructor Summary

Constructors

Constructor and Description
DataTableSource(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier, Table table, boolean unbounded, org.apache.flink.table.factories.DynamicTableFactory.Context context, LogStoreTableFactory logStoreTableFactory)
DataTableSource(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier, Table table, boolean unbounded, org.apache.flink.table.factories.DynamicTableFactory.Context context, LogStoreTableFactory logStoreTableFactory, Predicate predicate, int[][] projectFields, Long limit, org.apache.flink.api.common.eventtime.WatermarkStrategy<org.apache.flink.table.data.RowData> watermarkStrategy, List<String> dynamicPartitionFilteringFields, Long countPushed)

Method Summary

Modifier and Type	Method and Description
void	applyDynamicFiltering(List<String> candidateFilterFields)
DataTableSource	copy()
protected List<String>	dynamicPartitionFilteringFields()
List<String>	listAcceptedFilterFields()
org.apache.flink.table.plan.stats.TableStats	reportStatistics()

Methods inherited from class org.apache.paimon.flink.source.BaseDataTableSource

applyAggregates, applyWatermark, asSummaryString, getChangelogMode, getFileStoreLookupFunction, getLookupRuntimeProvider, getPartitioner, getScanRuntimeProvider, isUnbounded

Methods inherited from class org.apache.paimon.flink.source.FlinkTableSource

applyFilters, applyLimit, applyProjection, getPredicateWithScanPartitions, getTable, inferSourceParallelism, scanSplitsForInference, supportsNestedProjection

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown

applyProjection

Constructor Detail

DataTableSource

public DataTableSource(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier,
                       Table table,
                       boolean unbounded,
                       org.apache.flink.table.factories.DynamicTableFactory.Context context,
                       @Nullable
                       LogStoreTableFactory logStoreTableFactory)

DataTableSource

public DataTableSource(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier,
                       Table table,
                       boolean unbounded,
                       org.apache.flink.table.factories.DynamicTableFactory.Context context,
                       @Nullable
                       LogStoreTableFactory logStoreTableFactory,
                       @Nullable
                       Predicate predicate,
                       @Nullable
                       int[][] projectFields,
                       @Nullable
                       Long limit,
                       @Nullable
                       org.apache.flink.api.common.eventtime.WatermarkStrategy<org.apache.flink.table.data.RowData> watermarkStrategy,
                       @Nullable
                       List<String> dynamicPartitionFilteringFields,
                       @Nullable
                       Long countPushed)

Method Detail

copy

public DataTableSource copy()

Specified by:

copy in interface org.apache.flink.table.connector.source.DynamicTableSource

reportStatistics

public org.apache.flink.table.plan.stats.TableStats reportStatistics()

Specified by:

reportStatistics in interface org.apache.flink.table.connector.source.abilities.SupportsStatisticReport

listAcceptedFilterFields

public List<String> listAcceptedFilterFields()

Specified by:

listAcceptedFilterFields in interface org.apache.flink.table.connector.source.abilities.SupportsDynamicFiltering

applyDynamicFiltering

public void applyDynamicFiltering(List<String> candidateFilterFields)

Specified by:

applyDynamicFiltering in interface org.apache.flink.table.connector.source.abilities.SupportsDynamicFiltering

dynamicPartitionFilteringFields

protected List<String> dynamicPartitionFilteringFields()

Specified by:

dynamicPartitionFilteringFields in class BaseDataTableSource