org.apache.paimon.flink.source.operator

Class CombinedAwareStreamingSourceFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichSourceFunction<T>

org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction<org.apache.flink.api.java.tuple.Tuple2<Split,String>>

org.apache.paimon.flink.source.operator.CombinedAwareStreamingSourceFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.source.SourceFunction<org.apache.flink.api.java.tuple.Tuple2<Split,String>>

public class CombinedAwareStreamingSourceFunction
extends CombinedCompactorSourceFunction<org.apache.flink.api.java.tuple.Tuple2<Split,String>>

It is responsible for monitoring compactor source of multi bucket table in stream mode.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T>

Field Summary

Fields inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction

catalogLoader, ctx, databasePattern, excludingPattern, includingPattern, isRunning, isStreaming

Constructor Summary

Constructors

Constructor and Description
CombinedAwareStreamingSourceFunction(Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, long monitorInterval)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData>	buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String name, org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.table.data.RowData> typeInfo, Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, long monitorInterval)
void	close()
void	open(org.apache.flink.configuration.Configuration parameters)

Methods inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction

cancel, run

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.functions.RichFunction

open

Constructor Detail

CombinedAwareStreamingSourceFunction

public CombinedAwareStreamingSourceFunction(Catalog.Loader catalogLoader,
                                            Pattern includingPattern,
                                            Pattern excludingPattern,
                                            Pattern databasePattern,
                                            long monitorInterval)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CombinedCompactorSourceFunction<org.apache.flink.api.java.tuple.Tuple2<Split,String>>

Throws:

Exception

buildSource

public static org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                                                    String name,
                                                                                                                    org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.table.data.RowData> typeInfo,
                                                                                                                    Catalog.Loader catalogLoader,
                                                                                                                    Pattern includingPattern,
                                                                                                                    Pattern excludingPattern,
                                                                                                                    Pattern databasePattern,
                                                                                                                    long monitorInterval)

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception