org.apache.paimon.flink.sink

Class UnawareBucketSink<T>

java.lang.Object

org.apache.paimon.flink.sink.FlinkSink<T>

org.apache.paimon.flink.sink.FlinkWriteSink<T>

org.apache.paimon.flink.sink.UnawareBucketSink<T>

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

RowUnawareBucketSink

public abstract class UnawareBucketSink<T>
extends FlinkWriteSink<T>

Sink for unaware-bucket table.

Note: in unaware-bucket mode, we don't shuffle by bucket in inserting. We can assign compaction to the inserting jobs aside.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected LogSinkFunction	logSinkFunction
protected Integer	parallelism
protected FileStoreTable	table

Constructor Summary

Constructors

Constructor and Description
UnawareBucketSink(FileStoreTable table, Map<String,String> overwritePartitions, LogSinkFunction logSinkFunction, Integer parallelism)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.streaming.api.datastream.DataStream<Committable>	doWrite(org.apache.flink.streaming.api.datastream.DataStream<T> input, String initialCommitUser, Integer parallelism)

Methods inherited from class org.apache.paimon.flink.sink.FlinkWriteSink

createCommittableStateManager, createCommitterFactory

Methods inherited from class org.apache.paimon.flink.sink.FlinkSink

assertBatchAdaptiveParallelism, assertBatchAdaptiveParallelism, assertStreamingConfiguration, configureGlobalCommitter, createWriteOperator, doCommit, isStreaming, isStreaming, sinkFrom, sinkFrom

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

table

protected final FileStoreTable table

logSinkFunction

protected final LogSinkFunction logSinkFunction

parallelism

@Nullable
protected final Integer parallelism

Constructor Detail

UnawareBucketSink

public UnawareBucketSink(FileStoreTable table,
                         @Nullable
                         Map<String,String> overwritePartitions,
                         LogSinkFunction logSinkFunction,
                         @Nullable
                         Integer parallelism)

Method Detail

doWrite

public org.apache.flink.streaming.api.datastream.DataStream<Committable> doWrite(org.apache.flink.streaming.api.datastream.DataStream<T> input,
                                                                                 String initialCommitUser,
                                                                                 @Nullable
                                                                                 Integer parallelism)

Overrides:

doWrite in class FlinkSink<T>