org.apache.paimon.flink.action.cdc.format

Class AbstractJsonRecordParser

java.lang.Object

org.apache.paimon.flink.action.cdc.format.AbstractRecordParser

org.apache.paimon.flink.action.cdc.format.AbstractJsonRecordParser

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.FlatMapFunction<CdcSourceRecord,RichCdcMultiplexRecord>, org.apache.flink.api.common.functions.Function

Direct Known Subclasses:

CanalRecordParser, DebeziumJsonRecordParser, JsonRecordParser, MaxwellRecordParser, OggRecordParser

public abstract class AbstractJsonRecordParser
extends AbstractRecordParser

Provides a base implementation for parsing messages of various formats into RichCdcMultiplexRecord objects.

This abstract class defines common functionalities and fields required for parsing messages. Subclasses are expected to provide specific implementations for extracting records, validating message formats, and other format-specific operations.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode	root

Fields inherited from class org.apache.paimon.flink.action.cdc.format.AbstractRecordParser

computedColumns, FIELD_DATABASE, FIELD_TABLE, typeMapping

Constructor Summary

Constructors

Constructor and Description
AbstractJsonRecordParser(TypeMapping typeMapping, List<ComputedColumn> computedColumns)

Method Summary

Modifier and Type	Method and Description
protected void	checkNotNull(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode node, String key)
protected void	checkNotNull(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode node, String key, String conditionKey, String conditionValue)
protected abstract String	dataField()
protected List<String>	extractPrimaryKeys()
protected Map<String,String>	extractRowData(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode record, RowType.Builder rowTypeBuilder)
protected void	fillDefaultTypes(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode record, RowType.Builder rowTypeBuilder)
protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode	getAndCheck(String key)
protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode	getAndCheck(String key, String conditionKey, String conditionValue)
protected String	getDatabaseName()
protected String	getTableName()
protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode	mergeOldRecord(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode data, org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode oldNode)
protected abstract String	primaryField()
protected void	processRecord(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode jsonNode, RowKind rowKind, List<RichCdcMultiplexRecord> records)
protected void	setRoot(CdcSourceRecord record)

Methods inherited from class org.apache.paimon.flink.action.cdc.format.AbstractRecordParser

buildSchema, createRecord, evalComputedColumns, extractRecords, flatMap, format, isDDL

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

root

protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode root

Constructor Detail

AbstractJsonRecordParser

public AbstractJsonRecordParser(TypeMapping typeMapping,
                                List<ComputedColumn> computedColumns)

Method Detail

setRoot

protected void setRoot(CdcSourceRecord record)

Specified by:

setRoot in class AbstractRecordParser

primaryField

protected abstract String primaryField()

dataField

protected abstract String dataField()

fillDefaultTypes

protected void fillDefaultTypes(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode record,
                                RowType.Builder rowTypeBuilder)

extractRowData

protected Map<String,String> extractRowData(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode record,
                                            RowType.Builder rowTypeBuilder)

extractPrimaryKeys

protected List<String> extractPrimaryKeys()

Specified by:

extractPrimaryKeys in class AbstractRecordParser

processRecord

protected void processRecord(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode jsonNode,
                             RowKind rowKind,
                             List<RichCdcMultiplexRecord> records)

mergeOldRecord

protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode mergeOldRecord(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode data,
                                                                                                  org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode oldNode)

getTableName

@Nullable
protected String getTableName()

Specified by:

getTableName in class AbstractRecordParser

getDatabaseName

@Nullable
protected String getDatabaseName()

Specified by:

getDatabaseName in class AbstractRecordParser

checkNotNull

protected void checkNotNull(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode node,
                            String key)

checkNotNull

protected void checkNotNull(org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode node,
                            String key,
                            String conditionKey,
                            String conditionValue)

getAndCheck

protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode getAndCheck(String key)

getAndCheck

protected org.apache.paimon.shade.jackson2.com.fasterxml.jackson.databind.JsonNode getAndCheck(String key,
                                                                                               String conditionKey,
                                                                                               String conditionValue)