org.apache.paimon.flink.action.cdc.mongodb

Class MongoDBSyncDatabaseAction

java.lang.Object

org.apache.paimon.flink.action.ActionBase

org.apache.paimon.flink.action.cdc.SynchronizationActionBase

org.apache.paimon.flink.action.cdc.SyncDatabaseActionBase

org.apache.paimon.flink.action.cdc.mongodb.MongoDBSyncDatabaseAction

All Implemented Interfaces:

Action

public class MongoDBSyncDatabaseAction
extends SyncDatabaseActionBase

An action class responsible for synchronizing MongoDB databases with a target system.

This class provides functionality to read data from a MongoDB source, process it, and then synchronize it with a target system. It supports various configurations, including table prefixes, suffixes, and inclusion/exclusion patterns.

Key features include:

• Support for case-sensitive and case-insensitive database and table names.
• Configurable table name conversion with prefixes and suffixes.
• Ability to include or exclude specific tables using regular expressions.
• Integration with Flink's streaming environment for data processing.

Note: This action is primarily intended for use in Flink streaming applications that synchronize MongoDB data with other systems.

Field Summary

Fields inherited from class org.apache.paimon.flink.action.cdc.SyncDatabaseActionBase

excludingTables, includingTables, mergeShards, mode, partitionKeyMultiple, partitionKeys, primaryKeys, tablePrefix, tables, tableSuffix

Fields inherited from class org.apache.paimon.flink.action.cdc.SynchronizationActionBase

allowUpperCase, cdcSourceConfig, database, metadataConverters, syncJobHandler, tableConfig, typeMapping

Fields inherited from class org.apache.paimon.flink.action.ActionBase

batchTEnv, catalog, catalogName, catalogOptions, env, flinkCatalog

Constructor Summary

Constructors

Constructor and Description
MongoDBSyncDatabaseAction(String warehouse, String database, Map<String,String> catalogConfig, Map<String,String> mongodbConfig)

Method Summary

Modifier and Type	Method and Description
protected org.apache.flink.cdc.connectors.mongodb.source.MongoDBSource<CdcSourceRecord>	buildSource()
protected CdcTimestampExtractor	createCdcTimestampExtractor()
protected boolean	requirePrimaryKeys()

Methods inherited from class org.apache.paimon.flink.action.cdc.SyncDatabaseActionBase

buildEventParserFactory, buildSink, excludingTables, includingTables, mergeShards, recordParse, validateCaseSensitivity, withMode, withPartitionKeyMultiple, withPartitionKeys, withPrimaryKeys, withTablePrefix, withTableSuffix

Methods inherited from class org.apache.paimon.flink.action.cdc.SynchronizationActionBase

alterTableOptions, beforeBuildingSourceSink, build, run, tableConfig, validateRuntimeExecutionMode, withMetadataColumns, withTableConfig, withTypeMapping

Methods inherited from class org.apache.paimon.flink.action.ActionBase

catalogConfig, catalogLoader, compatibleCheck, execute, initFlinkCatalog, initFlinkEnv, initPaimonCatalog, toPaimonTypes, withStreamExecutionEnvironment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MongoDBSyncDatabaseAction

public MongoDBSyncDatabaseAction(String warehouse,
                                 String database,
                                 Map<String,String> catalogConfig,
                                 Map<String,String> mongodbConfig)

Method Detail

createCdcTimestampExtractor

protected CdcTimestampExtractor createCdcTimestampExtractor()

Overrides:

createCdcTimestampExtractor in class SynchronizationActionBase

buildSource

protected org.apache.flink.cdc.connectors.mongodb.source.MongoDBSource<CdcSourceRecord> buildSource()

Overrides:

buildSource in class SynchronizationActionBase

requirePrimaryKeys

protected boolean requirePrimaryKeys()

Specified by:

requirePrimaryKeys in class SyncDatabaseActionBase