public abstract class CombinedCompactorSourceFunction<T>
extends org.apache.flink.streaming.api.functions.source.RichSourceFunction<T>
Split
or compaction task UnawareAppendCompactionTask
corresponding to the incremental files
The splits to be read are forwarded to the downstream MultiTablesReadOperator
which
can have parallelism greater than one.
Currently, only dedicated compaction job for multi-tables rely on this monitor. This is the single (non-parallel) monitoring task, it is responsible for the new Paimon table.
Modifier and Type | Field and Description |
---|---|
protected Catalog.Loader |
catalogLoader |
protected org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> |
ctx |
protected Pattern |
databasePattern |
protected Pattern |
excludingPattern |
protected Pattern |
includingPattern |
protected AtomicBoolean |
isRunning |
protected boolean |
isStreaming |
Constructor and Description |
---|
CombinedCompactorSourceFunction(Catalog.Loader catalogLoader,
Pattern includingPattern,
Pattern excludingPattern,
Pattern databasePattern,
boolean isStreaming) |
Modifier and Type | Method and Description |
---|---|
void |
cancel() |
void |
open(org.apache.flink.configuration.Configuration parameters) |
void |
run(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext) |
close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
protected final Catalog.Loader catalogLoader
protected final Pattern includingPattern
protected final Pattern excludingPattern
protected final Pattern databasePattern
protected final boolean isStreaming
protected transient AtomicBoolean isRunning
protected transient org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> ctx
public CombinedCompactorSourceFunction(Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, boolean isStreaming)
public void open(org.apache.flink.configuration.Configuration parameters) throws Exception
open
in interface org.apache.flink.api.common.functions.RichFunction
open
in class org.apache.flink.api.common.functions.AbstractRichFunction
Exception
public void run(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext) throws Exception
Exception
public void cancel()
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.