Package | Description |
---|---|
org.apache.paimon.flink.source | |
org.apache.paimon.flink.source.align | |
org.apache.paimon.flink.source.assigners |
Modifier and Type | Field and Description |
---|---|
protected SplitAssigner |
ContinuousFileSplitEnumerator.splitAssigner |
Modifier and Type | Method and Description |
---|---|
protected SplitAssigner |
ContinuousFileSplitEnumerator.createSplitAssigner(BucketMode bucketMode) |
static SplitAssigner |
StaticFileStoreSource.createSplitAssigner(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
int splitBatchSize,
FlinkConnectorOptions.SplitAssignMode splitAssignMode,
Collection<FileStoreSourceSplit> splits) |
SplitAssigner |
StaticFileStoreSplitEnumerator.getSplitAssigner() |
Constructor and Description |
---|
StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Snapshot snapshot,
SplitAssigner splitAssigner) |
StaticFileStoreSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileStoreSourceSplit> context,
Snapshot snapshot,
SplitAssigner splitAssigner,
DynamicPartitionFilteringInfo dynamicPartitionFilteringInfo) |
Modifier and Type | Method and Description |
---|---|
protected SplitAssigner |
AlignedContinuousFileSplitEnumerator.createSplitAssigner(BucketMode bucketMode) |
Modifier and Type | Class and Description |
---|---|
class |
AlignedSplitAssigner
Splits are allocated at the granularity of snapshots.
|
class |
DynamicPartitionPruningAssigner
Assigner to perform dynamic partition pruning by given
DynamicFilteringData . |
class |
FIFOSplitAssigner
Splits are assigned preemptively in the order requested by the task.
|
class |
PreAssignSplitAssigner
Pre-calculate which splits each task should process according to the weight or given
DynamicFilteringData, and then distribute the splits fairly.
|
Modifier and Type | Method and Description |
---|---|
static SplitAssigner |
DynamicPartitionPruningAssigner.createDynamicPartitionPruningAssignerIfNeeded(int subtaskId,
SplitAssigner oriAssigner,
Projection partitionRowProjection,
org.apache.flink.api.connector.source.SourceEvent sourceEvent,
org.slf4j.Logger logger) |
SplitAssigner |
PreAssignSplitAssigner.ofDynamicPartitionPruning(Projection partitionRowProjection,
org.apache.flink.table.connector.source.DynamicFilteringData dynamicFilteringData) |
Modifier and Type | Method and Description |
---|---|
static SplitAssigner |
DynamicPartitionPruningAssigner.createDynamicPartitionPruningAssignerIfNeeded(int subtaskId,
SplitAssigner oriAssigner,
Projection partitionRowProjection,
org.apache.flink.api.connector.source.SourceEvent sourceEvent,
org.slf4j.Logger logger) |
Constructor and Description |
---|
DynamicPartitionPruningAssigner(SplitAssigner innerAssigner,
Projection partitionRowProjection,
org.apache.flink.table.connector.source.DynamicFilteringData dynamicFilteringData) |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.