org.apache.paimon.flink.source

Class StaticFileStoreSplitEnumerator

java.lang.Object

org.apache.paimon.flink.source.StaticFileStoreSplitEnumerator

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>, SupportsHandleExecutionAttemptSourceEvent

public class StaticFileStoreSplitEnumerator
extends Object
implements org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>, SupportsHandleExecutionAttemptSourceEvent

A SplitEnumerator implementation for StaticFileStoreSource input.

Constructor Summary

Constructors

Constructor and Description
StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context, Snapshot snapshot, SplitAssigner splitAssigner)
StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context, Snapshot snapshot, SplitAssigner splitAssigner, DynamicPartitionFilteringInfo dynamicPartitionFilteringInfo)

Method Summary

Modifier and Type	Method and Description
void	addReader(int subtaskId)
void	addSplitsBack(List<FileStoreSourceSplit> backSplits, int subtaskId)
void	close()
SplitAssigner	getSplitAssigner()
void	handleSourceEvent(int subtaskId, int attemptNumber, org.apache.flink.api.connector.source.SourceEvent sourceEvent) Handles a custom source event from the source reader.
void	handleSourceEvent(int subtaskId, org.apache.flink.api.connector.source.SourceEvent sourceEvent) When to support a new kind of event, pay attention that whether the new event can be sent multiple times from different attempts of one subtask.
void	handleSplitRequest(int subtask, String hostname)
Snapshot	snapshot()
PendingSplitsCheckpoint	snapshotState(long checkpointId)
void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.SplitEnumerator

notifyCheckpointComplete

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Constructor Detail

StaticFileStoreSplitEnumerator

public StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
                                      @Nullable
                                      Snapshot snapshot,
                                      SplitAssigner splitAssigner)

StaticFileStoreSplitEnumerator

public StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
                                      @Nullable
                                      Snapshot snapshot,
                                      SplitAssigner splitAssigner,
                                      @Nullable
                                      DynamicPartitionFilteringInfo dynamicPartitionFilteringInfo)

Method Detail

start

public void start()

Specified by:

start in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

handleSplitRequest

public void handleSplitRequest(int subtask,
                               @Nullable
                               String hostname)

Specified by:

handleSplitRequest in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

addSplitsBack

public void addSplitsBack(List<FileStoreSourceSplit> backSplits,
                          int subtaskId)

Specified by:

addSplitsBack in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

addReader

public void addReader(int subtaskId)

Specified by:

addReader in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

snapshotState

public PendingSplitsCheckpoint snapshotState(long checkpointId)

Specified by:

snapshotState in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

snapshot

@Nullable
public Snapshot snapshot()

handleSourceEvent

public void handleSourceEvent(int subtaskId,
                              int attemptNumber,
                              org.apache.flink.api.connector.source.SourceEvent sourceEvent)

Description copied from interface: SupportsHandleExecutionAttemptSourceEvent

Handles a custom source event from the source reader. It is similar to SplitEnumerator.handleSourceEvent(int, SourceEvent) but is aware of the subtask execution attempt who sent this event.

Specified by:

handleSourceEvent in interface SupportsHandleExecutionAttemptSourceEvent

Parameters:

subtaskId - the subtask id of the source reader who sent the source event.

attemptNumber - the attempt number of the source reader who sent the source event.

sourceEvent - the source event from the source reader.

handleSourceEvent

public void handleSourceEvent(int subtaskId,
                              org.apache.flink.api.connector.source.SourceEvent sourceEvent)

When to support a new kind of event, pay attention that whether the new event can be sent multiple times from different attempts of one subtask. If so, it should be handled via method handleSourceEvent(int, int, SourceEvent)

Specified by:

handleSourceEvent in interface org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint>

getSplitAssigner

@VisibleForTesting
public SplitAssigner getSplitAssigner()