org.apache.paimon.flink.sink.cdc

Class FlinkCdcSyncDatabaseSinkBuilder<T>

java.lang.Object

org.apache.paimon.flink.sink.cdc.FlinkCdcSyncDatabaseSinkBuilder<T>

Type Parameters:

T - CDC change event type

public class FlinkCdcSyncDatabaseSinkBuilder<T>
extends Object

Builder for CDC FlinkWriteSink when syncing the whole database into one Paimon database. Each database table will be written into a separate Paimon table.

This builder will create a separate sink for each Paimon sink table. Thus this implementation is not very efficient in resource saving.

For newly added tables, this builder will create a multiplexed Paimon sink to handle all tables added during runtime. Note that the topology of the Flink job is likely to change when there is newly added table and the job resume from a given savepoint.

Constructor Summary

Constructors

Constructor and Description
FlinkCdcSyncDatabaseSinkBuilder()

Method Summary

Modifier and Type	Method and Description
void	build()
FlinkCdcSyncDatabaseSinkBuilder<T>	withCatalogLoader(Catalog.Loader catalogLoader)
FlinkCdcSyncDatabaseSinkBuilder<T>	withDatabase(String database)
FlinkCdcSyncDatabaseSinkBuilder<T>	withInput(org.apache.flink.streaming.api.datastream.DataStream<T> input)
FlinkCdcSyncDatabaseSinkBuilder<T>	withMode(MultiTablesSinkMode mode)
FlinkCdcSyncDatabaseSinkBuilder<T>	withParserFactory(EventParser.Factory<T> parserFactory)
FlinkCdcSyncDatabaseSinkBuilder<T>	withTableOptions(Map<String,String> options)
FlinkCdcSyncDatabaseSinkBuilder<T>	withTableOptions(Options options)
FlinkCdcSyncDatabaseSinkBuilder<T>	withTables(List<FileStoreTable> tables)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkCdcSyncDatabaseSinkBuilder

public FlinkCdcSyncDatabaseSinkBuilder()

Method Detail

withInput

public FlinkCdcSyncDatabaseSinkBuilder<T> withInput(org.apache.flink.streaming.api.datastream.DataStream<T> input)

withParserFactory

public FlinkCdcSyncDatabaseSinkBuilder<T> withParserFactory(EventParser.Factory<T> parserFactory)

withTables

public FlinkCdcSyncDatabaseSinkBuilder<T> withTables(List<FileStoreTable> tables)

withTableOptions

public FlinkCdcSyncDatabaseSinkBuilder<T> withTableOptions(Map<String,String> options)

withTableOptions

public FlinkCdcSyncDatabaseSinkBuilder<T> withTableOptions(Options options)

withDatabase

public FlinkCdcSyncDatabaseSinkBuilder<T> withDatabase(String database)

withCatalogLoader

public FlinkCdcSyncDatabaseSinkBuilder<T> withCatalogLoader(Catalog.Loader catalogLoader)

withMode

public FlinkCdcSyncDatabaseSinkBuilder<T> withMode(MultiTablesSinkMode mode)

build

public void build()