org.apache.paimon.flink.action.cdc.format.dms

Class DMSRecordParser

java.lang.Object

org.apache.paimon.flink.action.cdc.format.AbstractRecordParser

org.apache.paimon.flink.action.cdc.format.AbstractJsonRecordParser

org.apache.paimon.flink.action.cdc.format.dms.DMSRecordParser

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.FlatMapFunction<CdcSourceRecord,RichCdcMultiplexRecord>, org.apache.flink.api.common.functions.Function

public class DMSRecordParser
extends AbstractJsonRecordParser

The DMSRecordParser class extends the abstract AbstractJsonRecordParser and is designed to parse records from AWS DMS's JSON change data capture (CDC) format. AWS DMS is a CDC solution for RDMS that captures row-level changes to database tables and outputs them in JSON format. This parser extracts relevant information from the DMS-JSON format and converts it into a list of RichCdcMultiplexRecord objects.

The class supports various database operations such as INSERT, UPDATE, and DELETE, and creates corresponding RichCdcMultiplexRecord objects to represent these changes.

Validation is performed to ensure that the JSON records contain all necessary fields, and the class also supports schema extraction for the Kafka topic.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.paimon.flink.action.cdc.format.AbstractJsonRecordParser

root

Fields inherited from class org.apache.paimon.flink.action.cdc.format.AbstractRecordParser

computedColumns, typeMapping

Constructor Summary

Constructors

Constructor and Description
DMSRecordParser(TypeMapping typeMapping, List<ComputedColumn> computedColumns)

Method Summary

Modifier and Type	Method and Description
protected String	dataField()
protected List<RichCdcMultiplexRecord>	extractRecords()
protected String	format()
protected String	getDatabaseName()
protected String	getTableName()
protected boolean	isDDL()
protected String	primaryField()

Methods inherited from class org.apache.paimon.flink.action.cdc.format.AbstractJsonRecordParser

checkNotNull, checkNotNull, extractPrimaryKeys, extractRowData, fillDefaultTypes, getAndCheck, getAndCheck, mergeOldRecord, processRecord, setRoot

Methods inherited from class org.apache.paimon.flink.action.cdc.format.AbstractRecordParser

buildSchema, createRecord, evalComputedColumns, flatMap

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DMSRecordParser

public DMSRecordParser(TypeMapping typeMapping,
                       List<ComputedColumn> computedColumns)

Method Detail

getTableName

@Nullable
protected String getTableName()

Overrides:

getTableName in class AbstractJsonRecordParser

extractRecords

protected List<RichCdcMultiplexRecord> extractRecords()

Specified by:

extractRecords in class AbstractRecordParser

getDatabaseName

@Nullable
protected String getDatabaseName()

Overrides:

getDatabaseName in class AbstractJsonRecordParser

primaryField

protected String primaryField()

Specified by:

primaryField in class AbstractJsonRecordParser

dataField

protected String dataField()

Specified by:

dataField in class AbstractJsonRecordParser

format

protected String format()

Specified by:

format in class AbstractRecordParser

isDDL

protected boolean isDDL()

Overrides:

isDDL in class AbstractRecordParser