public class SplitsParallelReadUtil extends Object
ParallelExecution
to parallel execution for Split
reader.Constructor and Description |
---|
SplitsParallelReadUtil() |
Modifier and Type | Method and Description |
---|---|
static RecordReader<InternalRow> |
parallelExecute(RowType projectedType,
FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
List<Split> splits,
int pageSize,
int parallelism) |
static <EXTRA> RecordReader<InternalRow> |
parallelExecute(RowType projectedType,
FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder,
List<Split> splits,
int pageSize,
int parallelism,
java.util.function.Function<Split,EXTRA> extraFunction,
java.util.function.BiFunction<InternalRow,EXTRA,InternalRow> addExtraToRow) |
public static RecordReader<InternalRow> parallelExecute(RowType projectedType, FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder, List<Split> splits, int pageSize, int parallelism)
public static <EXTRA> RecordReader<InternalRow> parallelExecute(RowType projectedType, FunctionWithIOException<Split,RecordReader<InternalRow>> readBuilder, List<Split> splits, int pageSize, int parallelism, java.util.function.Function<Split,EXTRA> extraFunction, java.util.function.BiFunction<InternalRow,EXTRA,InternalRow> addExtraToRow)
Copyright © 2023–2024 The Apache Software Foundation. All rights reserved.