org.apache.paimon.flink.source

Class FlinkRecordsWithSplitIds

java.lang.Object

org.apache.paimon.flink.source.FlinkRecordsWithSplitIds

All Implemented Interfaces:

org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>

public class FlinkRecordsWithSplitIds
extends Object
implements org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>

A RecordsWithSplitIds which contains only one iterator record. This can ensure that there will be no checkpoint segmentation in iterator consumption.

Method Summary

Modifier and Type	Method and Description
static void	emitRecord(org.apache.flink.api.connector.source.SourceReaderContext context, org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData> element, org.apache.flink.api.connector.source.SourceOutput<org.apache.flink.table.data.RowData> output, FileStoreSourceSplitState state, FileStoreSourceReaderMetrics metrics)
static FlinkRecordsWithSplitIds	finishedSplit(String splitId)
Set<String>	finishedSplits()
static FlinkRecordsWithSplitIds	forRecords(String splitId, org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData> recordsForSplit)
org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>	nextRecordFromSplit()
String	nextSplit()
void	recycle()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

nextSplit

@Nullable
public String nextSplit()

Specified by:

nextSplit in interface org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>

nextRecordFromSplit

@Nullable
public org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData> nextRecordFromSplit()

Specified by:

nextRecordFromSplit in interface org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>

finishedSplits

public Set<String> finishedSplits()

Specified by:

finishedSplits in interface org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>

recycle

public void recycle()

Specified by:

recycle in interface org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData>>

forRecords

public static FlinkRecordsWithSplitIds forRecords(String splitId,
                                                  org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData> recordsForSplit)

finishedSplit

public static FlinkRecordsWithSplitIds finishedSplit(String splitId)

emitRecord

public static void emitRecord(org.apache.flink.api.connector.source.SourceReaderContext context,
                              org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<org.apache.flink.table.data.RowData> element,
                              org.apache.flink.api.connector.source.SourceOutput<org.apache.flink.table.data.RowData> output,
                              FileStoreSourceSplitState state,
                              FileStoreSourceReaderMetrics metrics)