Package | Description |
---|---|
org.apache.paimon.flink.source | |
org.apache.paimon.flink.source.align | |
org.apache.paimon.flink.source.assigners | |
org.apache.paimon.flink.utils |
Modifier and Type | Field and Description |
---|---|
protected org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> |
ContinuousFileSplitEnumerator.context |
Modifier and Type | Method and Description |
---|---|
FileStoreSourceSplit |
FileStoreSourceSplitSerializer.deserialize(int version,
byte[] serialized) |
FileStoreSourceSplit |
FileStoreSourceSplitState.toSourceSplit() |
protected FileStoreSourceSplit |
FileStoreSourceReader.toSplitType(String splitId,
FileStoreSourceSplitState splitState) |
FileStoreSourceSplit |
FileStoreSourceSplit.updateWithRecordsToSkip(long recordsToSkip) |
Modifier and Type | Method and Description |
---|---|
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
ContinuousFileStoreSource.buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits,
Long nextSnapshotId,
StreamTableScan scan) |
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
FlinkSource.createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context) |
org.apache.flink.api.connector.source.SourceReader<org.apache.flink.table.data.RowData,FileStoreSourceSplit> |
FlinkSource.createReader(org.apache.flink.api.connector.source.SourceReaderContext context) |
List<FileStoreSourceSplit> |
FileStoreSourceSplitGenerator.createSplits(List<Split> splits) |
List<FileStoreSourceSplit> |
FileStoreSourceSplitGenerator.createSplits(TableScan.Plan plan) |
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
StaticFileStoreSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
PendingSplitsCheckpoint checkpoint) |
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
ContinuousFileStoreSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
PendingSplitsCheckpoint checkpoint) |
Collection<FileStoreSourceSplit> |
PendingSplitsCheckpoint.splits() |
Modifier and Type | Method and Description |
---|---|
protected int |
ContinuousFileSplitEnumerator.assignSuggestedTask(FileStoreSourceSplit split) |
protected FileStoreSourceSplitState |
FileStoreSourceReader.initializedState(FileStoreSourceSplit split) |
byte[] |
FileStoreSourceSplitSerializer.serialize(FileStoreSourceSplit split) |
void |
ConsumerProgressCalculator.updateAssignInformation(int subtaskId,
FileStoreSourceSplit split) |
Modifier and Type | Method and Description |
---|---|
protected void |
ContinuousFileSplitEnumerator.addSplits(Collection<FileStoreSourceSplit> splits) |
void |
StaticFileStoreSplitEnumerator.addSplitsBack(List<FileStoreSourceSplit> backSplits,
int subtaskId) |
void |
ContinuousFileSplitEnumerator.addSplitsBack(List<FileStoreSourceSplit> splits,
int subtaskId) |
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
ContinuousFileStoreSource.buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits,
Long nextSnapshotId,
StreamTableScan scan) |
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
ContinuousFileStoreSource.buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits,
Long nextSnapshotId,
StreamTableScan scan) |
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
FlinkSource.createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context) |
static SplitAssigner |
StaticFileStoreSource.createSplitAssigner(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
int splitBatchSize,
FlinkConnectorOptions.SplitAssignMode splitAssignMode,
Collection<FileStoreSourceSplit> splits) |
static SplitAssigner |
StaticFileStoreSource.createSplitAssigner(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
int splitBatchSize,
FlinkConnectorOptions.SplitAssignMode splitAssignMode,
Collection<FileStoreSourceSplit> splits) |
void |
FileStoreSourceSplitReader.handleSplitsChanges(org.apache.flink.connector.base.source.reader.splitreader.SplitsChange<FileStoreSourceSplit> splitsChange) |
void |
FileStoreSourceSplitReader.pauseOrResumeSplits(Collection<FileStoreSourceSplit> splitsToPause,
Collection<FileStoreSourceSplit> splitsToResume)
Do not annotate with
@override here to maintain compatibility with Flink 1.7-. |
void |
FileStoreSourceSplitReader.pauseOrResumeSplits(Collection<FileStoreSourceSplit> splitsToPause,
Collection<FileStoreSourceSplit> splitsToResume)
Do not annotate with
@override here to maintain compatibility with Flink 1.7-. |
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
StaticFileStoreSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
PendingSplitsCheckpoint checkpoint) |
org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
ContinuousFileStoreSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
PendingSplitsCheckpoint checkpoint) |
Constructor and Description |
---|
FileStoreSourceSplitState(FileStoreSourceSplit split) |
Constructor and Description |
---|
ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> remainSplits,
Long nextSnapshotId,
long discoveryInterval,
StreamTableScan scan,
BucketMode bucketMode,
int splitMaxPerTask,
boolean shuffleBucketWithPartition) |
ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> remainSplits,
Long nextSnapshotId,
long discoveryInterval,
StreamTableScan scan,
BucketMode bucketMode,
int splitMaxPerTask,
boolean shuffleBucketWithPartition) |
PendingSplitsCheckpoint(Collection<FileStoreSourceSplit> splits,
Long currentSnapshotId) |
StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Snapshot snapshot,
SplitAssigner splitAssigner) |
StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Snapshot snapshot,
SplitAssigner splitAssigner,
DynamicPartitionFilteringInfo dynamicPartitionFilteringInfo) |
Modifier and Type | Method and Description |
---|---|
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
AlignedContinuousFileStoreSource.buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits,
Long nextSnapshotId,
StreamTableScan scan) |
org.apache.flink.api.connector.source.SourceReader<org.apache.flink.table.data.RowData,FileStoreSourceSplit> |
AlignedContinuousFileStoreSource.createReader(org.apache.flink.api.connector.source.SourceReaderContext context) |
Modifier and Type | Method and Description |
---|---|
protected void |
AlignedContinuousFileSplitEnumerator.addSplits(Collection<FileStoreSourceSplit> splits) |
void |
AlignedContinuousFileSplitEnumerator.addSplitsBack(List<FileStoreSourceSplit> splits,
int subtaskId) |
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
AlignedContinuousFileStoreSource.buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits,
Long nextSnapshotId,
StreamTableScan scan) |
protected org.apache.flink.api.connector.source.SplitEnumerator<FileStoreSourceSplit,PendingSplitsCheckpoint> |
AlignedContinuousFileStoreSource.buildEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits,
Long nextSnapshotId,
StreamTableScan scan) |
Constructor and Description |
---|
AlignedContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> remainSplits,
Long nextSnapshotId,
long discoveryInterval,
StreamTableScan scan,
BucketMode bucketMode,
long alignTimeout,
int splitPerTaskMax,
boolean shuffleBucketWithPartition) |
AlignedContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> remainSplits,
Long nextSnapshotId,
long discoveryInterval,
StreamTableScan scan,
BucketMode bucketMode,
long alignTimeout,
int splitPerTaskMax,
boolean shuffleBucketWithPartition) |
Modifier and Type | Method and Description |
---|---|
List<FileStoreSourceSplit> |
SplitAssigner.getNext(int subtask,
String hostname)
Gets the next split.
|
List<FileStoreSourceSplit> |
AlignedSplitAssigner.getNext(int subtask,
String hostname) |
List<FileStoreSourceSplit> |
PreAssignSplitAssigner.getNext(int subtask,
String hostname) |
List<FileStoreSourceSplit> |
DynamicPartitionPruningAssigner.getNext(int subtask,
String hostname) |
List<FileStoreSourceSplit> |
FIFOSplitAssigner.getNext(int subtask,
String hostname) |
Collection<FileStoreSourceSplit> |
SplitAssigner.remainingSplits()
Gets the remaining splits that this assigner has pending.
|
Collection<FileStoreSourceSplit> |
AlignedSplitAssigner.remainingSplits() |
Collection<FileStoreSourceSplit> |
PreAssignSplitAssigner.remainingSplits() |
Collection<FileStoreSourceSplit> |
DynamicPartitionPruningAssigner.remainingSplits() |
Collection<FileStoreSourceSplit> |
FIFOSplitAssigner.remainingSplits() |
Modifier and Type | Method and Description |
---|---|
void |
SplitAssigner.addSplit(int suggestedTask,
FileStoreSourceSplit splits)
Add one split of a specified subtask to the assigner.
|
void |
AlignedSplitAssigner.addSplit(int subtask,
FileStoreSourceSplit splits) |
void |
PreAssignSplitAssigner.addSplit(int suggestedTask,
FileStoreSourceSplit split) |
void |
DynamicPartitionPruningAssigner.addSplit(int suggestedTask,
FileStoreSourceSplit splits) |
void |
FIFOSplitAssigner.addSplit(int suggestedTask,
FileStoreSourceSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
SplitAssigner.addSplitsBack(int subtask,
List<FileStoreSourceSplit> splits)
Adds a set of splits to this assigner.
|
void |
AlignedSplitAssigner.addSplitsBack(int suggestedTask,
List<FileStoreSourceSplit> splits) |
void |
PreAssignSplitAssigner.addSplitsBack(int subtask,
List<FileStoreSourceSplit> splits) |
void |
DynamicPartitionPruningAssigner.addSplitsBack(int subtask,
List<FileStoreSourceSplit> splits) |
void |
FIFOSplitAssigner.addSplitsBack(int subtask,
List<FileStoreSourceSplit> splits) |
Constructor and Description |
---|
FIFOSplitAssigner(Collection<FileStoreSourceSplit> splits) |
PreAssignSplitAssigner(int splitBatchSize,
org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits) |
PreAssignSplitAssigner(int splitBatchSize,
org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Collection<FileStoreSourceSplit> splits) |
Modifier and Type | Method and Description |
---|---|
static Optional<Long> |
TableScanUtils.getSnapshotId(FileStoreSourceSplit split)
Get snapshot id from
FileStoreSourceSplit . |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.