org.apache.paimon.flink.lookup.partitioner

Class BucketShufflePartitioner

java.lang.Object

org.apache.paimon.flink.lookup.partitioner.BucketShufflePartitioner

All Implemented Interfaces:

Serializable, SupportsLookupCustomShuffle.InputDataPartitioner

public class BucketShufflePartitioner
extends Object
implements SupportsLookupCustomShuffle.InputDataPartitioner

BucketShufflePartitioner class partitions rows based on the bucket id. It uses a custom strategy and an extractor to determine the target partition for a given set of join keys.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BucketShufflePartitioner(ShuffleStrategy strategy, BucketIdExtractor extractor)

Method Summary

Modifier and Type	Method and Description
int	partition(org.apache.flink.table.data.RowData joinKeys, int numPartitions) Determining the partition id for each input data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.connector.source.abilities.SupportsLookupCustomShuffle.InputDataPartitioner

isDeterministic

Constructor Detail

BucketShufflePartitioner

public BucketShufflePartitioner(ShuffleStrategy strategy,
                                BucketIdExtractor extractor)

Method Detail

partition

public int partition(org.apache.flink.table.data.RowData joinKeys,
                     int numPartitions)

Description copied from interface: SupportsLookupCustomShuffle.InputDataPartitioner

Determining the partition id for each input data.

This data is projected to only including all join keys before emit to this partitioner.

Specified by:

partition in interface SupportsLookupCustomShuffle.InputDataPartitioner

Parameters:

joinKeys - The extracted join key for each input record.

numPartitions - The total number of partition.

Returns:

An integer representing the partition id to which the record should be sent.