org.apache.paimon.flink.sink.cdc

Class CdcMultiTableParsingProcessFunction<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<T,Void>

org.apache.paimon.flink.sink.cdc.CdcMultiTableParsingProcessFunction<T>

Type Parameters:

T - CDC change event type

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class CdcMultiTableParsingProcessFunction<T>
extends org.apache.flink.streaming.api.functions.ProcessFunction<T,Void>

A ProcessFunction to parse CDC change event to either a list of DataFields or CdcRecord and send them to different side outputs according to table name.

This ProcessFunction can handle records for different tables at the same time.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Constructor Summary

Constructors

Constructor and Description
CdcMultiTableParsingProcessFunction(EventParser.Factory<T> parserFactory)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.util.OutputTag<CdcRecord>	createRecordOutputTag(String tableName)
static org.apache.flink.util.OutputTag<List<DataField>>	createUpdatedDataFieldsOutputTag(String tableName)
void	open(org.apache.flink.configuration.Configuration parameters) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.
void	processElement(T raw, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<Void> collector)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CdcMultiTableParsingProcessFunction

public CdcMultiTableParsingProcessFunction(EventParser.Factory<T> parserFactory)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

processElement

public void processElement(T raw,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<Void> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<T,Void>

Throws:

Exception

createUpdatedDataFieldsOutputTag

public static org.apache.flink.util.OutputTag<List<DataField>> createUpdatedDataFieldsOutputTag(String tableName)

createRecordOutputTag

public static org.apache.flink.util.OutputTag<CdcRecord> createRecordOutputTag(String tableName)