org.apache.paimon.flink.source

Class FlinkTableSource

java.lang.Object

org.apache.paimon.flink.source.FlinkTableSource

All Implemented Interfaces:

org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown, org.apache.flink.table.connector.source.abilities.SupportsLimitPushDown, org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown, org.apache.flink.table.connector.source.DynamicTableSource, org.apache.flink.table.connector.source.ScanTableSource

Direct Known Subclasses:

BaseDataTableSource, SystemTableSource

public abstract class FlinkTableSource
extends Object
implements org.apache.flink.table.connector.source.ScanTableSource, org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown, org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown, org.apache.flink.table.connector.source.abilities.SupportsLimitPushDown

A Flink ScanTableSource for paimon.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	FlinkTableSource.SplitStatistics Split statistics for inferring row count and parallelism size.

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.ScanTableSource

org.apache.flink.table.connector.source.ScanTableSource.ScanContext, org.apache.flink.table.connector.source.ScanTableSource.ScanRuntimeProvider

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.DynamicTableSource

org.apache.flink.table.connector.source.DynamicTableSource.Context, org.apache.flink.table.connector.source.DynamicTableSource.DataStructureConverter

Nested classes/interfaces inherited from interface org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown

org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown.Result

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	FLINK_INFER_SCAN_PARALLELISM
protected Long	limit
protected Predicate	predicate
protected int[][]	projectFields
protected FlinkTableSource.SplitStatistics	splitStatistics
protected Table	table

Constructor Summary

Constructors

Constructor and Description
FlinkTableSource(Table table)
FlinkTableSource(Table table, Predicate predicate, int[][] projectFields, Long limit)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown.Result	applyFilters(List<org.apache.flink.table.expressions.ResolvedExpression> filters)
void	applyLimit(long limit)
void	applyProjection(int[][] projectedFields)
Table	getTable()
protected Integer	inferSourceParallelism(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
abstract boolean	isStreaming()
protected void	scanSplitsForInference()
boolean	supportsNestedProjection()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.connector.source.ScanTableSource

getChangelogMode, getScanRuntimeProvider

Methods inherited from interface org.apache.flink.table.connector.source.DynamicTableSource

asSummaryString, copy

Methods inherited from interface org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown

applyProjection

Field Detail

FLINK_INFER_SCAN_PARALLELISM

protected static final String FLINK_INFER_SCAN_PARALLELISM

table

protected final Table table

predicate

@Nullable
protected Predicate predicate

projectFields

@Nullable
protected int[][] projectFields

limit

@Nullable
protected Long limit

splitStatistics

protected FlinkTableSource.SplitStatistics splitStatistics

Constructor Detail

FlinkTableSource

public FlinkTableSource(Table table)

FlinkTableSource

public FlinkTableSource(Table table,
                        @Nullable
                        Predicate predicate,
                        @Nullable
                        int[][] projectFields,
                        @Nullable
                        Long limit)

Method Detail

applyFilters

public org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown.Result applyFilters(List<org.apache.flink.table.expressions.ResolvedExpression> filters)

Specified by:

applyFilters in interface org.apache.flink.table.connector.source.abilities.SupportsFilterPushDown

supportsNestedProjection

public boolean supportsNestedProjection()

Specified by:

supportsNestedProjection in interface org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown

applyProjection

public void applyProjection(int[][] projectedFields)

Specified by:

applyProjection in interface org.apache.flink.table.connector.source.abilities.SupportsProjectionPushDown

applyLimit

public void applyLimit(long limit)

Specified by:

applyLimit in interface org.apache.flink.table.connector.source.abilities.SupportsLimitPushDown

isStreaming

public abstract boolean isStreaming()

inferSourceParallelism

@Nullable
protected Integer inferSourceParallelism(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)

scanSplitsForInference

protected void scanSplitsForInference()

getTable

public Table getTable()