org.apache.paimon.flink.source.operator

Class CombinedAwareStreamingSource

java.lang.Object

org.apache.paimon.flink.source.AbstractNonCoordinatedSource<T>

org.apache.paimon.flink.source.operator.CombinedCompactorSource<org.apache.flink.api.java.tuple.Tuple2<Split,String>>

org.apache.paimon.flink.source.operator.CombinedAwareStreamingSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<org.apache.flink.api.java.tuple.Tuple2<Split,String>,SimpleSourceSplit,NoOpEnumState>, org.apache.flink.api.connector.source.SourceReaderFactory<org.apache.flink.api.java.tuple.Tuple2<Split,String>,SimpleSourceSplit>

public class CombinedAwareStreamingSource
extends CombinedCompactorSource<org.apache.flink.api.java.tuple.Tuple2<Split,String>>

It is responsible for monitoring compactor source of multi bucket table in stream mode.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSource

catalogLoader, databasePattern, excludingPattern, includingPattern, isStreaming

Constructor Summary

Constructors

Constructor and Description
CombinedAwareStreamingSource(CatalogLoader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, Map<String,String> tableOptions, long monitorInterval)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData>	buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String name, org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.table.data.RowData> typeInfo, CatalogLoader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, Map<String,String> tableOptions, long monitorInterval)
org.apache.flink.api.connector.source.SourceReader<org.apache.flink.api.java.tuple.Tuple2<Split,String>,SimpleSourceSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)

Methods inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSource

getBoundedness

Methods inherited from class org.apache.paimon.flink.source.AbstractNonCoordinatedSource

createEnumerator, getEnumeratorCheckpointSerializer, getSplitSerializer, restoreEnumerator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CombinedAwareStreamingSource

public CombinedAwareStreamingSource(CatalogLoader catalogLoader,
                                    Pattern includingPattern,
                                    Pattern excludingPattern,
                                    Pattern databasePattern,
                                    Map<String,String> tableOptions,
                                    long monitorInterval)

Method Detail

createReader

public org.apache.flink.api.connector.source.SourceReader<org.apache.flink.api.java.tuple.Tuple2<Split,String>,SimpleSourceSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)
                                                                                                                                        throws Exception

Throws:

Exception

buildSource

public static org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                                                    String name,
                                                                                                                    org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.table.data.RowData> typeInfo,
                                                                                                                    CatalogLoader catalogLoader,
                                                                                                                    Pattern includingPattern,
                                                                                                                    Pattern excludingPattern,
                                                                                                                    Pattern databasePattern,
                                                                                                                    Map<String,String> tableOptions,
                                                                                                                    long monitorInterval)