org.apache.paimon.flink.source.operator

Class CombinedUnawareStreamingSourceFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichSourceFunction<T>

org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

org.apache.paimon.flink.source.operator.CombinedUnawareStreamingSourceFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.source.SourceFunction<MultiTableUnawareAppendCompactionTask>

public class CombinedUnawareStreamingSourceFunction
extends CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

It is responsible for monitoring compactor source in stream mode for the table of unaware bucket.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T>

Field Summary

Fields inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction

catalogLoader, ctx, databasePattern, excludingPattern, includingPattern, isRunning, isStreaming

Constructor Summary

Constructors

Constructor and Description
CombinedUnawareStreamingSourceFunction(Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, long monitorInterval)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<MultiTableUnawareAppendCompactionTask>	buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String name, Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, long monitorInterval)
void	close()
void	open(org.apache.flink.configuration.Configuration parameters) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Methods inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction

cancel, run

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CombinedUnawareStreamingSourceFunction

public CombinedUnawareStreamingSourceFunction(Catalog.Loader catalogLoader,
                                              Pattern includingPattern,
                                              Pattern excludingPattern,
                                              Pattern databasePattern,
                                              long monitorInterval)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

Throws:

Exception

buildSource

public static org.apache.flink.streaming.api.datastream.DataStream<MultiTableUnawareAppendCompactionTask> buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                                                      String name,
                                                                                                                      Catalog.Loader catalogLoader,
                                                                                                                      Pattern includingPattern,
                                                                                                                      Pattern excludingPattern,
                                                                                                                      Pattern databasePattern,
                                                                                                                      long monitorInterval)

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception