org.apache.paimon.flink.source.operator

Class CombinedUnawareBatchSource

java.lang.Object

org.apache.paimon.flink.source.AbstractNonCoordinatedSource<T>

org.apache.paimon.flink.source.operator.CombinedCompactorSource<MultiTableUnawareAppendCompactionTask>

org.apache.paimon.flink.source.operator.CombinedUnawareBatchSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<MultiTableUnawareAppendCompactionTask,SimpleSourceSplit,NoOpEnumState>, org.apache.flink.api.connector.source.SourceReaderFactory<MultiTableUnawareAppendCompactionTask,SimpleSourceSplit>

public class CombinedUnawareBatchSource
extends CombinedCompactorSource<MultiTableUnawareAppendCompactionTask>

It is responsible for the batch compactor source of the table with unaware bucket in combined mode.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSource

catalogLoader, databasePattern, excludingPattern, includingPattern, isStreaming

Constructor Summary

Constructors

Constructor and Description
CombinedUnawareBatchSource(CatalogLoader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.streaming.api.datastream.DataStream<MultiTableUnawareAppendCompactionTask>	buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String name, CatalogLoader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, java.time.Duration partitionIdleTime)
org.apache.flink.api.connector.source.SourceReader<MultiTableUnawareAppendCompactionTask,SimpleSourceSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)

Methods inherited from class org.apache.paimon.flink.source.operator.CombinedCompactorSource

getBoundedness

Methods inherited from class org.apache.paimon.flink.source.AbstractNonCoordinatedSource

createEnumerator, getEnumeratorCheckpointSerializer, getSplitSerializer, restoreEnumerator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CombinedUnawareBatchSource

public CombinedUnawareBatchSource(CatalogLoader catalogLoader,
                                  Pattern includingPattern,
                                  Pattern excludingPattern,
                                  Pattern databasePattern)

Method Detail

createReader

public org.apache.flink.api.connector.source.SourceReader<MultiTableUnawareAppendCompactionTask,SimpleSourceSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)
                                                                                                                         throws Exception

Throws:

Exception

buildSource

public static org.apache.flink.streaming.api.datastream.DataStream<MultiTableUnawareAppendCompactionTask> buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                                                      String name,
                                                                                                                      CatalogLoader catalogLoader,
                                                                                                                      Pattern includingPattern,
                                                                                                                      Pattern excludingPattern,
                                                                                                                      Pattern databasePattern,
                                                                                                                      @Nullable
                                                                                                                      java.time.Duration partitionIdleTime)