org.apache.paimon.io

Class SplitsParallelReadUtil

java.lang.Object

org.apache.paimon.io.SplitsParallelReadUtil

public class SplitsParallelReadUtil
extends Object

An util class to wrap ParallelExecution to parallel execution for Split reader.

Constructor Summary

Constructors

Constructor and Description
SplitsParallelReadUtil()

Method Summary

Modifier and Type	Method and Description
static RecordReader<InternalRow>	parallelExecute(RowType projectedType, FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder, List<Split> splits, int pageSize, int parallelism)
static <EXTRA> RecordReader<InternalRow>	parallelExecute(RowType projectedType, FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder, List<Split> splits, int pageSize, int parallelism, java.util.function.Function<Split,EXTRA> extraFunction, java.util.function.BiFunction<InternalRow,EXTRA,InternalRow> addExtraToRow)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SplitsParallelReadUtil

public SplitsParallelReadUtil()

Method Detail

parallelExecute

public static RecordReader<InternalRow> parallelExecute(RowType projectedType,
                                                        FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
                                                        List<Split> splits,
                                                        int pageSize,
                                                        int parallelism)

parallelExecute

public static <EXTRA> RecordReader<InternalRow> parallelExecute(RowType projectedType,
                                                                FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
                                                                List<Split> splits,
                                                                int pageSize,
                                                                int parallelism,
                                                                java.util.function.Function<Split,EXTRA> extraFunction,
                                                                java.util.function.BiFunction<InternalRow,EXTRA,InternalRow> addExtraToRow)