org.apache.paimon.flink.sink.cdc

Class UpdatedDataFieldsProcessFunctionBase<I,O>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

org.apache.paimon.flink.sink.cdc.UpdatedDataFieldsProcessFunctionBase<I,O>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

Direct Known Subclasses:

MultiTableUpdatedDataFieldsProcessFunction, UpdatedDataFieldsProcessFunction

public abstract class UpdatedDataFieldsProcessFunctionBase<I,O>
extends org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

Base class for update data fields process function.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	UpdatedDataFieldsProcessFunctionBase.ConvertAction Return type of canConvert(org.apache.paimon.types.DataType, org.apache.paimon.types.DataType, org.apache.paimon.flink.action.cdc.TypeMapping).

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields

Modifier and Type	Field and Description
protected Catalog	catalog
protected CatalogLoader	catalogLoader

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	UpdatedDataFieldsProcessFunctionBase(CatalogLoader catalogLoader, TypeMapping typeMapping)

Method Summary

Modifier and Type	Method and Description
protected List<DataField>	actualUpdatedDataFields(List<DataField> newFields, Set<FieldIdentifier> latestFields)
protected void	applySchemaChange(SchemaManager schemaManager, SchemaChange schemaChange, Identifier identifier)
static UpdatedDataFieldsProcessFunctionBase.ConvertAction	canConvert(DataType oldType, DataType newType, TypeMapping typeMapping)
void	close()
protected List<SchemaChange>	extractSchemaChanges(SchemaManager schemaManager, CdcSchema updatedSchema)
void	open(org.apache.flink.configuration.Configuration parameters) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.
protected Set<FieldIdentifier>	updateLatestFields(SchemaManager schemaManager)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer, processElement

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

catalogLoader

protected final CatalogLoader catalogLoader

catalog

protected Catalog catalog

Constructor Detail

UpdatedDataFieldsProcessFunctionBase

protected UpdatedDataFieldsProcessFunctionBase(CatalogLoader catalogLoader,
                                               TypeMapping typeMapping)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

applySchemaChange

protected void applySchemaChange(SchemaManager schemaManager,
                                 SchemaChange schemaChange,
                                 Identifier identifier)
                          throws Exception

Throws:

Exception

canConvert

public static UpdatedDataFieldsProcessFunctionBase.ConvertAction canConvert(DataType oldType,
                                                                            DataType newType,
                                                                            TypeMapping typeMapping)

extractSchemaChanges

protected List<SchemaChange> extractSchemaChanges(SchemaManager schemaManager,
                                                  CdcSchema updatedSchema)

actualUpdatedDataFields

protected List<DataField> actualUpdatedDataFields(List<DataField> newFields,
                                                  Set<FieldIdentifier> latestFields)

updateLatestFields

protected Set<FieldIdentifier> updateLatestFields(SchemaManager schemaManager)

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception