org.apache.paimon.flink.source

Class ContinuousFileStoreSource

java.lang.Object

org.apache.paimon.flink.source.FlinkSource

org.apache.paimon.flink.source.ContinuousFileStoreSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<org.apache.flink.table.data.RowData,FileStoreSourceSplit,PendingSplitsCheckpoint>, org.apache.flink.api.connector.source.SourceReaderFactory<org.apache.flink.table.data.RowData,FileStoreSourceSplit>

Direct Known Subclasses:

AlignedContinuousFileStoreSource

public class ContinuousFileStoreSource
extends FlinkSource

Unbounded FlinkSource for reading records. It continuously monitors new snapshots.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected BucketMode	bucketMode
protected Map<String,String>	options

Fields inherited from class org.apache.paimon.flink.source.FlinkSource

limit, readBuilder

Constructor Summary

Constructors

Constructor and Description
ContinuousFileStoreSource(ReadBuilder readBuilder, Map<String,String> options, Long limit)
ContinuousFileStoreSource(ReadBuilder readBuilder, Map<String,String> options, Long limit, BucketMode bucketMode)

Method Summary

Modifier and Type	Method and Description
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>	buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context, Collection<FileStoreSourceSplit> splits, Long nextSnapshotId, StreamTableScan scan)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context, PendingSplitsCheckpoint checkpoint)

Methods inherited from class org.apache.paimon.flink.source.FlinkSource

createEnumerator, createReader, getEnumeratorCheckpointSerializer, getSplitSerializer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

options

protected final Map<String,String> options

bucketMode

protected final BucketMode bucketMode

Constructor Detail

ContinuousFileStoreSource

public ContinuousFileStoreSource(ReadBuilder readBuilder,
                                 Map<String,String> options,
                                 @Nullable
                                 Long limit)

ContinuousFileStoreSource

public ContinuousFileStoreSource(ReadBuilder readBuilder,
                                 Map<String,String> options,
                                 @Nullable
                                 Long limit,
                                 BucketMode bucketMode)

Method Detail

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
                                                                                                                             PendingSplitsCheckpoint checkpoint)

buildEnumerator

protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
                                                                                                                              Collection<FileStoreSourceSplit> splits,
                                                                                                                              @Nullable
                                                                                                                              Long nextSnapshotId,
                                                                                                                              StreamTableScan scan)