org.apache.paimon.flink.source.operator

Class CombinedUnawareBatchSourceFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichSourceFunction<T>

org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

org.apache.paimon.flink.source.operator.CombinedUnawareBatchSourceFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.source.SourceFunction<MultiTableUnawareAppendCompactionTask>

public class CombinedUnawareBatchSourceFunction
extends CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

It is responsible for the batch compactor source of the table with unaware bucket in combined mode.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T>

Field Summary

Fields inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction

catalogLoader, ctx, databasePattern, excludingPattern, includingPattern, isRunning, isStreaming

Constructor Summary

Constructors

Constructor and Description
CombinedUnawareBatchSourceFunction(Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<MultiTableUnawareAppendCompactionTask>	buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String name, Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, java.time.Duration partitionIdleTime)
void	close()
void	open(org.apache.flink.configuration.Configuration parameters) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Methods inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSourceFunction

cancel, run

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CombinedUnawareBatchSourceFunction

public CombinedUnawareBatchSourceFunction(Catalog.Loader catalogLoader,
                                          Pattern includingPattern,
                                          Pattern excludingPattern,
                                          Pattern databasePattern)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CombinedCompactorSourceFunction<MultiTableUnawareAppendCompactionTask>

Throws:

Exception

buildSource

public static org.apache.flink.streaming.api.datastream.DataStream<MultiTableUnawareAppendCompactionTask> buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                                                      String name,
                                                                                                                      Catalog.Loader catalogLoader,
                                                                                                                      Pattern includingPattern,
                                                                                                                      Pattern excludingPattern,
                                                                                                                      Pattern databasePattern,
                                                                                                                      @Nullable
                                                                                                                      java.time.Duration partitionIdleTime)

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception