org.apache.paimon.flink.service

Class QueryFileMonitor

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichSourceFunction<InternalRow>

org.apache.paimon.flink.service.QueryFileMonitor

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.source.SourceFunction<InternalRow>

public class QueryFileMonitor
extends org.apache.flink.streaming.api.functions.source.RichSourceFunction<InternalRow>

This is the single (non-parallel) monitoring task, it is responsible for:

1. Read incremental files from tables.
2. Assigning them to downstream tasks for further processing.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T>

Constructor Summary

Constructors

Constructor and Description
QueryFileMonitor(Table table)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<InternalRow>	build(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, Table table)
void	cancel()
static ChannelComputer<InternalRow>	createChannelComputer()
void	open(org.apache.flink.configuration.Configuration parameters) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.
void	run(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<InternalRow> ctx)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QueryFileMonitor

public QueryFileMonitor(Table table)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

run

public void run(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<InternalRow> ctx)
         throws Exception

Throws:

Exception

cancel

public void cancel()

build

public static org.apache.flink.streaming.api.datastream.DataStream<InternalRow> build(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                      Table table)

createChannelComputer

public static ChannelComputer<InternalRow> createChannelComputer()