Package org.apache.paimon.flink.sink

Interface Summary

Interface	Description
CommittableStateManager<GlobalCommitT>	Helper interface for CommitterOperator.
Committer<CommitT,GlobalCommitT>	The Committer is responsible for creating and committing an aggregated committable, which we call committable (see Committer.combine(long, long, java.util.List<CommitT>)).
Committer.Context	Context to create Committer.
Committer.Factory<CommitT,GlobalCommitT>	Factory to create Committer.
LogSinkFunction	Log SinkFunction with LogSinkFunction.WriteCallback.
LogSinkFunction.WriteCallback	A callback interface that the user can implement to know the offset of the bucket when the request is complete.
StoreSinkWrite	Helper class of PrepareCommitOperator for different types of paimon sinks.
StoreSinkWrite.Provider	Provider of StoreSinkWrite.
StoreSinkWrite.WithWriteBufferProvider	Provider of StoreSinkWrite that uses given write buffer.
StoreSinkWriteState	States for StoreSinkWrites.
StoreSinkWriteState.StateValueFilter	Given the table name, partition and bucket of a StoreSinkWriteState.StateValue in a union list state, decide whether to keep this StoreSinkWriteState.StateValue in this subtask.

Class Summary

Class	Description
AdaptiveParallelism	Get adaptive config from Flink.
AppendBypassCompactWorkerOperator	A AppendCompactWorkerOperator to bypass Committable inputs.
AppendBypassCompactWorkerOperator.Factory	StreamOperatorFactory of AppendBypassCompactWorkerOperator.
AppendCompactWorkerOperator<IN>	An abstract Operator to execute UnawareAppendCompactionTask passed from BucketUnawareCompactSource for compacting table.
AppendCompactWorkerOperator.Factory<IN>	StreamOperatorFactory of AppendCompactWorkerOperator.
AppendOnlyMultiTableCompactionWorkerOperator	Operator to execute UnawareAppendCompactionTask passed for support compacting multi unaware bucket tables in combined mode.
AppendOnlyMultiTableCompactionWorkerOperator.Factory	StreamOperatorFactory of AppendOnlyMultiTableCompactionWorkerOperator.
AppendOnlySingleTableCompactionWorkerOperator	Operator to execute UnawareAppendCompactionTask passed from BucketUnawareCompactSource for compacting single unaware bucket tables in divided mode.
AppendOnlySingleTableCompactionWorkerOperator.Factory	StreamOperatorFactory of AppendOnlySingleTableCompactionWorkerOperator.
AsyncLookupSinkWrite	StoreSinkWrite for tables with lookup changelog producer and CoreOptions.LOOKUP_WAIT set to false.
AutoTagForSavepointCommitterOperator<CommitT,GlobalCommitT>	Commit Committable for each snapshot using the CommitterOperator.
AutoTagForSavepointCommitterOperatorFactory<CommitT,GlobalCommitT>	StreamOperatorFactory for AutoTagForSavepointCommitterOperator.
BatchWriteGeneratorTagOperator<CommitT,GlobalCommitT>	Commit Committable for snapshot using the CommitterOperator.
BatchWriteGeneratorTagOperatorFactory<CommitT,GlobalCommitT>	StreamOperatorFactory for BatchWriteGeneratorTagOperator.
BucketsRowChannelComputer	ChannelComputer to partition RowData from CompactBucketsTable.
CombinedTableCompactorSink	A sink for processing multi-tables in dedicated compaction job.
Committable	Committable produced by PrepareCommitOperator.
CommittableSerializer	SimpleVersionedSerializer for Committable.
CommittableTypeInfo	Type information of Committable.
CommitterMetrics	Flink metrics for Committer.
CommitterOperator<CommitT,GlobalCommitT>	Operator to commit Committables for each snapshot.
CommitterOperatorFactory<CommitT,GlobalCommitT>	StreamOperatorFactory for CommitterOperator.
CompactionTaskSimpleSerializer	SimpleVersionedSerializer for UnawareAppendCompactionTask.
CompactionTaskTypeInfo	Type information of UnawareAppendCompactionTask.
CompactorSink	FlinkSink for dedicated compact jobs.
CompactorSinkBuilder	Builder for CompactorSink.
DynamicBucketCompactSink	This class is only used for generate compact sink topology for dynamic bucket table.
DynamicBucketRowWriteOperator	A PrepareCommitOperator to write InternalRow with bucket.
DynamicBucketRowWriteOperator.Factory	StreamOperatorFactory of DynamicBucketRowWriteOperator.
DynamicBucketSink<T>	Sink for dynamic bucket table.
FixedBucketSink	FlinkSink for writing records into fixed bucket Paimon table.
FlinkSink<T>	Abstract sink of paimon.
FlinkSinkBuilder	DataStream API for building Flink Sink.
FlinkStreamPartitioner<T>	A StreamPartitioner which wraps a ChannelComputer.
FlinkTableSink	Table sink to create sink.
FlinkTableSinkBase	Table sink to create sink.
FlinkWriteSink<T>	A FlinkSink to write records.
GlobalFullCompactionSinkWrite	StoreSinkWrite for execute full compaction globally.
HashBucketAssignerOperator<T>	Assign bucket for the input record, output record with bucket.
LocalMergeOperator	AbstractStreamOperator which buffer input record and apply merge function when the buffer is full.
LocalMergeOperator.Factory	StreamOperatorFactory of LocalMergeOperator.
LogFlinkSinkBuilder	A special version FlinkSinkBuilder with log sink.
LogOffsetCommittable	Log offset committable for a bucket.
MultiTableCommittable	MultiTableCommittable produced by PrepareCommitOperator.
MultiTableCommittableChannelComputer	ChannelComputer for MultiTableCommittable.
MultiTableCommittableSerializer	SimpleVersionedSerializer for MultiTableCommittable.
MultiTableCommittableTypeInfo	Type information of MultiTableCommittable.
MultiTableCompactionTaskTypeInfo	Type information of MultiTableUnawareAppendCompactionTask.
MultiTablesStoreCompactOperator	A dedicated operator for manual triggered compaction.
MultiTablesStoreCompactOperator.Factory	StreamOperatorFactory of MultiTablesStoreCompactOperator.
NoneCopyVersionedSerializerTypeSerializerProxy<T>	No copy SimpleVersionedSerializerTypeSerializerProxy.
NoopCommittableStateManager	A CommittableStateManager which does nothing.
NoopStoreSinkWriteState	A StoreSinkWriteState which stores nothing.
PrepareCommitOperator<IN,OUT>	Prepare commit operator to emit Committables.
PrepareCommitOperator.Factory<IN,OUT>	StreamOperatorFactory of PrepareCommitOperator.
RestoreAndFailCommittableStateManager<GlobalCommitT>	A CommittableStateManager which stores uncommitted ManifestCommittables in state.
RewriteFileIndexSink	File index sink for RewriteFileIndexProcedure.
RewriteFileIndexSink.FileIndexProcessor	Does the file index rewrite.
RowAssignerChannelComputer	Hash key of a RowData.
RowDataChannelComputer	ChannelComputer for InternalRow.
RowDataHashPartitionChannelComputer	This is only for partitioned unaware-buckets Append only table.
RowDataKeyAndBucketExtractor	KeyAndBucketExtractor for RowData.
RowDataStoreWriteOperator	A PrepareCommitOperator to write InternalRow.
RowDataStoreWriteOperator.Factory	StreamOperatorFactory of RowDataStoreWriteOperator.
RowDynamicBucketSink	Sink for dynamic bucket table.
RowUnawareBucketSink	An UnawareBucketSink which handles InternalRow.
RowWithBucketChannelComputer	Hash key of a RowData with bucket.
SortCompactSinkBuilder	A special version FlinkSinkBuilder for sort compact.
StateUtils	Utility class for sink state manipulation.
StoreCommitter	Committer for dynamic store.
StoreCompactOperator	A dedicated operator for manual triggered compaction.
StoreCompactOperator.Factory	StreamOperatorFactory of StoreCompactOperator.
StoreMultiCommitter	StoreMultiCommitter for multiple dynamic store.
StoreSinkWriteImpl	Default implementation of StoreSinkWrite.
StoreSinkWriteState.StateValue	A state value for StoreSinkWrite.
StoreSinkWriteStateImpl	Default implementation for StoreSinkWriteState.
StreamMapWithForwardingRecordAttributes<IN,OUT>	A StreamMap that forwards received RecordAttributes to downstream operators.
SupportsRowLevelOperationFlinkTableSink	Flink table sink that supports row level update and delete.
TableFilter	TableFilter is used to filter tables according to whitelist and prefix/suffix patterns.
TableWriteOperator<IN>	An abstract class for table write operator.
TableWriteOperator.Factory<IN>	StreamOperatorFactory of TableWriteOperator.
UnawareBucketCompactionSink	Compaction Sink for unaware-bucket table.
UnawareBucketSink<T>	Sink for unaware-bucket table.
WrappedManifestCommittableSerializer	VersionedSerializer for ManifestCommittable.

Enum Summary

Enum	Description
Committable.Kind	Kind of the produced Committable.
MultiTableCommittable.Kind	Kind of the produced Committable.