org.apache.paimon.flink.action.cdc.mongodb

Class MongoDBSyncTableAction

java.lang.Object

org.apache.paimon.flink.action.ActionBase

org.apache.paimon.flink.action.cdc.SynchronizationActionBase

org.apache.paimon.flink.action.cdc.SyncTableActionBase

org.apache.paimon.flink.action.cdc.mongodb.MongoDBSyncTableAction

All Implemented Interfaces:

Action

public class MongoDBSyncTableAction
extends SyncTableActionBase

Represents an action to synchronize a specific MongoDB table with a target system.

This action is responsible for:

• Validating the provided MongoDB configuration.
• Checking and ensuring the existence of the target database and table.
• Setting up the necessary Flink streaming environment for data synchronization.
• Handling case sensitivity considerations for database and table names.

Usage:

 MongoDBSyncTableAction action = new MongoDBSyncTableAction(...);
 action.run();
 

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.paimon.flink.action.cdc.SyncTableActionBase

SyncTableActionBase.SchemaRetrievalException

Field Summary

Fields inherited from class org.apache.paimon.flink.action.cdc.SyncTableActionBase

computedColumnArgs, computedColumns, fileStoreTable, partitionKeys, primaryKeys, table

Fields inherited from class org.apache.paimon.flink.action.cdc.SynchronizationActionBase

caseSensitive, cdcSourceConfig, database, metadataConverters, syncJobHandler, tableConfig, typeMapping

Fields inherited from class org.apache.paimon.flink.action.ActionBase

batchTEnv, catalog, catalogName, catalogOptions, env, flinkCatalog

Constructor Summary

Constructors

Constructor and Description
MongoDBSyncTableAction(String warehouse, String database, String table, Map<String,String> catalogConfig, Map<String,String> mongodbConfig)

Method Summary

Modifier and Type	Method and Description
protected org.apache.flink.cdc.connectors.mongodb.source.MongoDBSource<CdcSourceRecord>	buildSource()
protected CdcTimestampExtractor	createCdcTimestampExtractor()
protected Schema	retrieveSchema()

Methods inherited from class org.apache.paimon.flink.action.cdc.SyncTableActionBase

beforeBuildingSourceSink, buildEventParserFactory, buildPaimonSchema, buildSink, fileStoreTable, recordParse, validateCaseSensitivity, withComputedColumnArgs, withPartitionKeys, withPartitionKeys, withPrimaryKeys, withPrimaryKeys

Methods inherited from class org.apache.paimon.flink.action.cdc.SynchronizationActionBase

alterTableOptions, build, run, tableConfig, validateRuntimeExecutionMode, withMetadataColumns, withTableConfig, withTypeMapping

Methods inherited from class org.apache.paimon.flink.action.ActionBase

catalogConfig, catalogLoader, compatibleCheck, execute, initFlinkCatalog, initFlinkEnv, initPaimonCatalog, toPaimonTypes, withStreamExecutionEnvironment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MongoDBSyncTableAction

public MongoDBSyncTableAction(String warehouse,
                              String database,
                              String table,
                              Map<String,String> catalogConfig,
                              Map<String,String> mongodbConfig)

Method Detail

retrieveSchema

protected Schema retrieveSchema()

Specified by:

retrieveSchema in class SyncTableActionBase

createCdcTimestampExtractor

protected CdcTimestampExtractor createCdcTimestampExtractor()

Overrides:

createCdcTimestampExtractor in class SynchronizationActionBase

buildSource

protected org.apache.flink.cdc.connectors.mongodb.source.MongoDBSource<CdcSourceRecord> buildSource()

Overrides:

buildSource in class SynchronizationActionBase