org.apache.paimon.flink.sink.cdc

Class FlinkCdcMultiTableSink

java.lang.Object

org.apache.paimon.flink.sink.cdc.FlinkCdcMultiTableSink

All Implemented Interfaces:

Serializable

public class FlinkCdcMultiTableSink
extends Object
implements Serializable

A FlinkSink which accepts CdcRecord and waits for a schema change if necessary.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FlinkCdcMultiTableSink(Catalog.Loader catalogLoader, double commitCpuCores, MemorySize commitHeapMemory, boolean commitChaining, String commitUser)

Method Summary

Modifier and Type	Method and Description
protected CommittableStateManager<WrappedManifestCommittable>	createCommittableStateManager()
protected Committer.Factory<MultiTableCommittable,WrappedManifestCommittable>	createCommitterFactory()
protected org.apache.flink.streaming.api.operators.OneInputStreamOperator<CdcMultiplexRecord,MultiTableCommittable>	createWriteOperator(StoreSinkWrite.WithWriteBufferProvider writeProvider, String commitUser)
org.apache.flink.streaming.api.datastream.DataStreamSink<?>	sinkFrom(org.apache.flink.streaming.api.datastream.DataStream<CdcMultiplexRecord> input)
org.apache.flink.streaming.api.datastream.DataStreamSink<?>	sinkFrom(org.apache.flink.streaming.api.datastream.DataStream<CdcMultiplexRecord> input, String commitUser, StoreSinkWrite.WithWriteBufferProvider sinkProvider)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkCdcMultiTableSink

public FlinkCdcMultiTableSink(Catalog.Loader catalogLoader,
                              double commitCpuCores,
                              @Nullable
                              MemorySize commitHeapMemory,
                              boolean commitChaining,
                              String commitUser)

Method Detail

sinkFrom

public org.apache.flink.streaming.api.datastream.DataStreamSink<?> sinkFrom(org.apache.flink.streaming.api.datastream.DataStream<CdcMultiplexRecord> input)

sinkFrom

public org.apache.flink.streaming.api.datastream.DataStreamSink<?> sinkFrom(org.apache.flink.streaming.api.datastream.DataStream<CdcMultiplexRecord> input,
                                                                            String commitUser,
                                                                            StoreSinkWrite.WithWriteBufferProvider sinkProvider)

createWriteOperator

protected org.apache.flink.streaming.api.operators.OneInputStreamOperator<CdcMultiplexRecord,MultiTableCommittable> createWriteOperator(StoreSinkWrite.WithWriteBufferProvider writeProvider,
                                                                                                                                        String commitUser)

createCommitterFactory

protected Committer.Factory<MultiTableCommittable,WrappedManifestCommittable> createCommitterFactory()

createCommittableStateManager

protected CommittableStateManager<WrappedManifestCommittable> createCommittableStateManager()