org.apache.paimon.flink.source

Class RewriteFileIndexSource

java.lang.Object

org.apache.paimon.flink.source.RewriteFileIndexSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>, org.apache.flink.api.connector.source.SourceReaderFactory<ManifestEntry,RewriteFileIndexSource.Split>

public class RewriteFileIndexSource
extends Object
implements org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>

Bounded FlinkSource for reading records. It does not monitor new snapshots.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RewriteFileIndexSource.CheckpointState State for splits.
static class	RewriteFileIndexSource.Split Split to wrap ManifestEntry.

Constructor Summary

Constructors

Constructor and Description
RewriteFileIndexSource(FileStoreTable table, Predicate partitionPredicate)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.api.connector.source.SplitEnumerator<RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<RewriteFileIndexSource.Split> splitEnumeratorContext)
org.apache.flink.api.connector.source.SourceReader<ManifestEntry,RewriteFileIndexSource.Split>	createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.core.io.SimpleVersionedSerializer<RewriteFileIndexSource.CheckpointState>	getEnumeratorCheckpointSerializer()
org.apache.flink.core.io.SimpleVersionedSerializer<RewriteFileIndexSource.Split>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<RewriteFileIndexSource.Split> splitEnumeratorContext, RewriteFileIndexSource.CheckpointState checkpointState)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RewriteFileIndexSource

public RewriteFileIndexSource(FileStoreTable table,
                              @Nullable
                              Predicate partitionPredicate)

Method Detail

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

Specified by:

getBoundedness in interface org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>

createEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<RewriteFileIndexSource.Split> splitEnumeratorContext)
                                                                                                                                            throws Exception

Specified by:

createEnumerator in interface org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>

Throws:

Exception

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<RewriteFileIndexSource.Split> splitEnumeratorContext,
                                                                                                                                                    RewriteFileIndexSource.CheckpointState checkpointState)
                                                                                                                                             throws Exception

Specified by:

restoreEnumerator in interface org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>

Throws:

Exception

getSplitSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<RewriteFileIndexSource.Split> getSplitSerializer()

Specified by:

getSplitSerializer in interface org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>

getEnumeratorCheckpointSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<RewriteFileIndexSource.CheckpointState> getEnumeratorCheckpointSerializer()

Specified by:

getEnumeratorCheckpointSerializer in interface org.apache.flink.api.connector.source.Source<ManifestEntry,RewriteFileIndexSource.Split,RewriteFileIndexSource.CheckpointState>

createReader

public org.apache.flink.api.connector.source.SourceReader<ManifestEntry,RewriteFileIndexSource.Split> createReader(org.apache.flink.api.connector.source.SourceReaderContext sourceReaderContext)
                                                                                                            throws Exception

Specified by:

createReader in interface org.apache.flink.api.connector.source.SourceReaderFactory<ManifestEntry,RewriteFileIndexSource.Split>

Throws:

Exception