org.apache.paimon.flink.sink

Class DynamicBucketSink<T>

java.lang.Object

org.apache.paimon.flink.sink.FlinkSink<T>

org.apache.paimon.flink.sink.FlinkWriteSink<org.apache.flink.api.java.tuple.Tuple2<T,Integer>>

org.apache.paimon.flink.sink.DynamicBucketSink<T>

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

CdcDynamicBucketSinkBase, RowDynamicBucketSink

public abstract class DynamicBucketSink<T>
extends FlinkWriteSink<org.apache.flink.api.java.tuple.Tuple2<T,Integer>>

Sink for dynamic bucket table.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.paimon.flink.sink.FlinkSink

table

Constructor Summary

Constructors

Constructor and Description
DynamicBucketSink(FileStoreTable table, Map<String,String> overwritePartition)

Method Summary

Modifier and Type	Method and Description
protected abstract ChannelComputer<T>	assignerChannelComputer(Integer numAssigners)
org.apache.flink.streaming.api.datastream.DataStreamSink<?>	build(org.apache.flink.streaming.api.datastream.DataStream<T> input, Integer parallelism)
protected abstract ChannelComputer<org.apache.flink.api.java.tuple.Tuple2<T,Integer>>	channelComputer2()
protected HashBucketAssignerOperator<T>	createHashBucketAssignerOperator(String commitUser, Table table, Integer numAssigners, SerializableFunction<TableSchema,PartitionKeyExtractor<T>> extractorFunction, boolean overwrite)
protected abstract SerializableFunction<TableSchema,PartitionKeyExtractor<T>>	extractorFunction()

Methods inherited from class org.apache.paimon.flink.sink.FlinkWriteSink

createCommittableStateManager, createCommitterFactory

Methods inherited from class org.apache.paimon.flink.sink.FlinkSink

assertBatchAdaptiveParallelism, assertBatchAdaptiveParallelism, assertStreamingConfiguration, configureGlobalCommitter, createWriteOperator, doCommit, doWrite, isStreaming, isStreaming, sinkFrom, sinkFrom

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DynamicBucketSink

public DynamicBucketSink(FileStoreTable table,
                         @Nullable
                         Map<String,String> overwritePartition)

Method Detail

assignerChannelComputer

protected abstract ChannelComputer<T> assignerChannelComputer(Integer numAssigners)

channelComputer2

protected abstract ChannelComputer<org.apache.flink.api.java.tuple.Tuple2<T,Integer>> channelComputer2()

extractorFunction

protected abstract SerializableFunction<TableSchema,PartitionKeyExtractor<T>> extractorFunction()

createHashBucketAssignerOperator

protected HashBucketAssignerOperator<T> createHashBucketAssignerOperator(String commitUser,
                                                                         Table table,
                                                                         Integer numAssigners,
                                                                         SerializableFunction<TableSchema,PartitionKeyExtractor<T>> extractorFunction,
                                                                         boolean overwrite)

build

public org.apache.flink.streaming.api.datastream.DataStreamSink<?> build(org.apache.flink.streaming.api.datastream.DataStream<T> input,
                                                                         @Nullable
                                                                         Integer parallelism)