org.apache.paimon.flink.postpone

Class PostponeBucketCompactSplitSource

java.lang.Object

org.apache.paimon.flink.source.AbstractNonCoordinatedSource<Split>

org.apache.paimon.flink.postpone.PostponeBucketCompactSplitSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<Split,SimpleSourceSplit,NoOpEnumState>, org.apache.flink.api.connector.source.SourceReaderFactory<Split,SimpleSourceSplit>

public class PostponeBucketCompactSplitSource
extends AbstractNonCoordinatedSource<Split>

Source for compacting postpone bucket tables. This source scans all files from bucket = -2 directory and distributes the files to the readers.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PostponeBucketCompactSplitSource(ReadBuilder readBuilder)

Method Summary

Modifier and Type	Method and Description
static Pair<org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData>,org.apache.flink.streaming.api.datastream.DataStream<Committable>>	buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, String name, RowType rowType, ReadBuilder readBuilder, Integer parallelism)
org.apache.flink.api.connector.source.SourceReader<Split,SimpleSourceSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()

Methods inherited from class org.apache.paimon.flink.source.AbstractNonCoordinatedSource

createEnumerator, getEnumeratorCheckpointSerializer, getSplitSerializer, restoreEnumerator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PostponeBucketCompactSplitSource

public PostponeBucketCompactSplitSource(ReadBuilder readBuilder)

Method Detail

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

createReader

public org.apache.flink.api.connector.source.SourceReader<Split,SimpleSourceSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
                                                                                         throws Exception

Throws:

Exception

buildSource

public static Pair<org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData>,org.apache.flink.streaming.api.datastream.DataStream<Committable>> buildSource(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                                                                                                                                            String name,
                                                                                                                                                                                            RowType rowType,
                                                                                                                                                                                            ReadBuilder readBuilder,
                                                                                                                                                                                            @Nullable
                                                                                                                                                                                            Integer parallelism)