org.apache.paimon.flink.sink.cdc

Class CdcMultiTableParsingProcessFunction<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<T,Void>

org.apache.paimon.flink.sink.cdc.CdcMultiTableParsingProcessFunction<T>

Type Parameters:

T - CDC change event type

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class CdcMultiTableParsingProcessFunction<T>
extends org.apache.flink.streaming.api.functions.ProcessFunction<T,Void>

A ProcessFunction to parse CDC change event to either a list of DataFields or CdcRecord and send them to different side outputs according to table name.

This ProcessFunction can handle records for different tables at the same time.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Constructor Summary

Constructors

Constructor and Description
CdcMultiTableParsingProcessFunction(EventParser.Factory<T> parserFactory)

Method Summary

Modifier and Type	Method and Description
static org.apache.flink.util.OutputTag<CdcRecord>	createRecordOutputTag(String tableName)
static org.apache.flink.util.OutputTag<List<DataField>>	createUpdatedDataFieldsOutputTag(String tableName)
void	open(org.apache.flink.configuration.Configuration parameters)
void	processElement(T raw, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<Void> collector)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.functions.RichFunction

open

Constructor Detail

CdcMultiTableParsingProcessFunction

public CdcMultiTableParsingProcessFunction(EventParser.Factory<T> parserFactory)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

processElement

public void processElement(T raw,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<Void> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<T,Void>

Throws:

Exception

createUpdatedDataFieldsOutputTag

public static org.apache.flink.util.OutputTag<List<DataField>> createUpdatedDataFieldsOutputTag(String tableName)

createRecordOutputTag

public static org.apache.flink.util.OutputTag<CdcRecord> createRecordOutputTag(String tableName)