Package | Description |
---|---|
org.apache.paimon.flink.shuffle | |
org.apache.paimon.flink.sink | |
org.apache.paimon.flink.sorter | |
org.apache.paimon.utils |
Modifier and Type | Method and Description |
---|---|
static <T> org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.api.java.tuple.Tuple2<T,org.apache.flink.table.data.RowData>> |
RangeShuffle.rangeShuffleByKey(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.api.java.tuple.Tuple2<T,org.apache.flink.table.data.RowData>> inputDataStream,
SerializableSupplier<Comparator<T>> keyComparator,
org.apache.flink.api.common.typeinfo.TypeInformation<T> keyTypeInformation,
int localSampleSize,
int globalSampleSize,
int rangeNum,
int outParallelism,
RowType valueRowType,
boolean isSortBySize)
The RelNode with range-partition distribution will create the following transformations.
|
Modifier and Type | Method and Description |
---|---|
static <KEY> org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> |
SortUtils.sortStreamByKey(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> inputStream,
FileStoreTable table,
RowType sortKeyType,
org.apache.flink.api.common.typeinfo.TypeInformation<KEY> keyTypeInformation,
SerializableSupplier<Comparator<KEY>> shuffleKeyComparator,
org.apache.paimon.flink.sorter.SortUtils.KeyAbstract<KEY> shuffleKeyAbstract,
org.apache.paimon.flink.sorter.SortUtils.ShuffleKeyConvertor<KEY> convertor,
TableSortInfo tableSortInfo)
Sort the input stream by the key specified.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyComparatorSupplier
A
Supplier that returns the comparator for the file store key. |
class |
ValueEqualiserSupplier
A
Supplier that returns the equaliser for the file store value. |
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.