org.apache.paimon.flink.sink.cdc

Class UpdatedDataFieldsProcessFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

org.apache.paimon.flink.sink.cdc.UpdatedDataFieldsProcessFunctionBase<List<DataField>,Void>

org.apache.paimon.flink.sink.cdc.UpdatedDataFieldsProcessFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class UpdatedDataFieldsProcessFunction
extends UpdatedDataFieldsProcessFunctionBase<List<DataField>,Void>

A ProcessFunction to handle schema changes. New schema is represented by a list of DataFields.

NOTE: To avoid concurrent schema changes, the parallelism of this ProcessFunction must be 1.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.flink.sink.cdc.UpdatedDataFieldsProcessFunctionBase

UpdatedDataFieldsProcessFunctionBase.ConvertAction

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields inherited from class org.apache.paimon.flink.sink.cdc.UpdatedDataFieldsProcessFunctionBase

catalog, catalogLoader

Constructor Summary

Constructors

Constructor and Description
UpdatedDataFieldsProcessFunction(SchemaManager schemaManager, Identifier identifier, Catalog.Loader catalogLoader)

Method Summary

Modifier and Type	Method and Description
void	processElement(List<DataField> updatedDataFields, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<Void> collector)

Methods inherited from class org.apache.paimon.flink.sink.cdc.UpdatedDataFieldsProcessFunctionBase

applySchemaChange, canConvert, close, extractSchemaChanges, open, open

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UpdatedDataFieldsProcessFunction

public UpdatedDataFieldsProcessFunction(SchemaManager schemaManager,
                                        Identifier identifier,
                                        Catalog.Loader catalogLoader)

Method Detail

processElement

public void processElement(List<DataField> updatedDataFields,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<Void> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<List<DataField>,Void>

Throws:

Exception