org.apache.paimon.flink.service

Class QueryFileMonitor

java.lang.Object

org.apache.paimon.flink.source.AbstractNonCoordinatedSource<InternalRow>

org.apache.paimon.flink.service.QueryFileMonitor

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<InternalRow,SimpleSourceSplit,NoOpEnumState>, org.apache.flink.api.connector.source.SourceReaderFactory<InternalRow,SimpleSourceSplit>

public class QueryFileMonitor
extends AbstractNonCoordinatedSource<InternalRow>

This is the single (non-parallel) monitoring task, it is responsible for:

1. Read incremental files from tables.
2. Assigning them to downstream tasks for further processing.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
QueryFileMonitor(Table table)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<InternalRow>	build(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, Table table)
static ChannelComputer<InternalRow>	createChannelComputer()
org.apache.flink.api.connector.source.SourceReader<InternalRow,SimpleSourceSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()

Methods inherited from class org.apache.paimon.flink.source.AbstractNonCoordinatedSource

createEnumerator, getEnumeratorCheckpointSerializer, getSplitSerializer, restoreEnumerator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QueryFileMonitor

public QueryFileMonitor(Table table)

Method Detail

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

createReader

public org.apache.flink.api.connector.source.SourceReader<InternalRow,SimpleSourceSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)
                                                                                               throws Exception

Throws:

Exception

build

public static org.apache.flink.streaming.api.datastream.DataStream<InternalRow> build(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                      Table table)

createChannelComputer

public static ChannelComputer<InternalRow> createChannelComputer()