org.apache.paimon.flink.source

Class FileStoreSourceReader

java.lang.Object

org.apache.flink.connector.base.source.reader.SourceReaderBase<E,T,SplitT,SplitStateT>

org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

org.apache.paimon.flink.source.FileStoreSourceReader

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SourceReader<org.apache.flink.table.data.RowData,FileStoreSourceSplit>

Direct Known Subclasses:

AlignedSourceReader

public class FileStoreSourceReader
extends org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

A SourceReader that read records from FileStoreSourceSplit.

Field Summary

Fields inherited from class org.apache.flink.connector.base.source.reader.SourceReaderBase

config, context, options, recordEmitter, splitFetcherManager

Constructor Summary

Constructors

Constructor and Description
FileStoreSourceReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext, TableRead tableRead, FileStoreSourceReaderMetrics metrics, IOManager ioManager, Long limit)
FileStoreSourceReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext, TableRead tableRead, FileStoreSourceReaderMetrics metrics, IOManager ioManager, Long limit, org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>> elementsQueue)

Method Summary

Modifier and Type	Method and Description
void	close()
protected FileStoreSourceSplitState	initializedState(FileStoreSourceSplit split)
protected void	onSplitFinished(Map<String,FileStoreSourceSplitState> finishedSplitIds)
void	start()
protected FileStoreSourceSplit	toSplitType(String splitId, FileStoreSourceSplitState splitState)

Methods inherited from class org.apache.flink.connector.base.source.reader.SourceReaderBase

addSplits, getNumberOfCurrentlyAssignedSplits, handleSourceEvents, isAvailable, notifyNoMoreSplits, pauseOrResumeSplits, pollNext, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.SourceReader

notifyCheckpointComplete

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Constructor Detail

FileStoreSourceReader

public FileStoreSourceReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext,
                             TableRead tableRead,
                             FileStoreSourceReaderMetrics metrics,
                             IOManager ioManager,
                             @Nullable
                             Long limit)

FileStoreSourceReader

public FileStoreSourceReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext,
                             TableRead tableRead,
                             FileStoreSourceReaderMetrics metrics,
                             IOManager ioManager,
                             @Nullable
                             Long limit,
                             org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>> elementsQueue)

Method Detail

start

public void start()

Specified by:

start in interface org.apache.flink.api.connector.source.SourceReader<org.apache.flink.table.data.RowData,FileStoreSourceSplit>

Overrides:

start in class org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

onSplitFinished

protected void onSplitFinished(Map<String,FileStoreSourceSplitState> finishedSplitIds)

Specified by:

onSplitFinished in class org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

initializedState

protected FileStoreSourceSplitState initializedState(FileStoreSourceSplit split)

Specified by:

initializedState in class org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

toSplitType

protected FileStoreSourceSplit toSplitType(String splitId,
                                           FileStoreSourceSplitState splitState)

Specified by:

toSplitType in class org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>,org.apache.flink.table.data.RowData,FileStoreSourceSplit,FileStoreSourceSplitState>

Throws:

Exception