org.apache.paimon.flink.sink.cdc

Class CdcParsingProcessFunction<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<T,CdcRecord>

org.apache.paimon.flink.sink.cdc.CdcParsingProcessFunction<T>

Type Parameters:

T - CDC change event type

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class CdcParsingProcessFunction<T>
extends org.apache.flink.streaming.api.functions.ProcessFunction<T,CdcRecord>

A ProcessFunction to parse CDC change event to either a list of DataFields or CdcRecord and send them to different downstreams.

This ProcessFunction can only handle records for a single constant table. To handle records for different tables, see CdcMultiTableParsingProcessFunction.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.flink.util.OutputTag<List<DataField>>	NEW_DATA_FIELD_LIST_OUTPUT_TAG

Constructor Summary

Constructors

Constructor and Description
CdcParsingProcessFunction(EventParser.Factory<T> parserFactory)

Method Summary

Modifier and Type	Method and Description
void	open(org.apache.flink.configuration.Configuration parameters) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.
void	processElement(T raw, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<CdcRecord> collector)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NEW_DATA_FIELD_LIST_OUTPUT_TAG

public static final org.apache.flink.util.OutputTag<List<DataField>> NEW_DATA_FIELD_LIST_OUTPUT_TAG

Constructor Detail

CdcParsingProcessFunction

public CdcParsingProcessFunction(EventParser.Factory<T> parserFactory)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

processElement

public void processElement(T raw,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<CdcRecord> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<T,CdcRecord>

Throws:

Exception