T
- CDC change event typepublic class FlinkCdcSyncDatabaseSinkBuilder<T> extends Object
FlinkWriteSink
when syncing the whole database into one Paimon database.
Each database table will be written into a separate Paimon table.
This builder will create a separate sink for each Paimon sink table. Thus this implementation is not very efficient in resource saving.
For newly added tables, this builder will create a multiplexed Paimon sink to handle all tables added during runtime. Note that the topology of the Flink job is likely to change when there is newly added table and the job resume from a given savepoint.
Constructor and Description |
---|
FlinkCdcSyncDatabaseSinkBuilder() |
Modifier and Type | Method and Description |
---|---|
void |
build() |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withCatalogLoader(Catalog.Loader catalogLoader) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withDatabase(String database) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withInput(org.apache.flink.streaming.api.datastream.DataStream<T> input) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withMode(MultiTablesSinkMode mode) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withParserFactory(EventParser.Factory<T> parserFactory) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withTableOptions(Map<String,String> options) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withTableOptions(Options options) |
FlinkCdcSyncDatabaseSinkBuilder<T> |
withTables(List<FileStoreTable> tables) |
public FlinkCdcSyncDatabaseSinkBuilder<T> withInput(org.apache.flink.streaming.api.datastream.DataStream<T> input)
public FlinkCdcSyncDatabaseSinkBuilder<T> withParserFactory(EventParser.Factory<T> parserFactory)
public FlinkCdcSyncDatabaseSinkBuilder<T> withTables(List<FileStoreTable> tables)
public FlinkCdcSyncDatabaseSinkBuilder<T> withTableOptions(Map<String,String> options)
public FlinkCdcSyncDatabaseSinkBuilder<T> withTableOptions(Options options)
public FlinkCdcSyncDatabaseSinkBuilder<T> withDatabase(String database)
public FlinkCdcSyncDatabaseSinkBuilder<T> withCatalogLoader(Catalog.Loader catalogLoader)
public FlinkCdcSyncDatabaseSinkBuilder<T> withMode(MultiTablesSinkMode mode)
public void build()
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.