org.apache.paimon.utils

Class ParallelExecution<T,E>

java.lang.Object

org.apache.paimon.utils.ParallelExecution<T,E>

Type Parameters:

T - Record Type.

E - Extra message of one RecordReader.

All Implemented Interfaces:

Closeable, AutoCloseable

public class ParallelExecution<T,E>
extends Object
implements Closeable

A class to help parallel execution.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	ParallelExecution.ParallelBatch<T,E> A batch provides next and extra message.

Constructor Summary

Constructors

Constructor and Description
ParallelExecution(Serializer<T> serializer, int pageSize, int parallelism, List<java.util.function.Supplier<Pair<RecordReader<T>,E>>> readers)

Method Summary

Modifier and Type	Method and Description
void	close()
ParallelExecution.ParallelBatch<T,E>	take()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParallelExecution

public ParallelExecution(Serializer<T> serializer,
                         int pageSize,
                         int parallelism,
                         List<java.util.function.Supplier<Pair<RecordReader<T>,E>>> readers)

Method Detail

take

@Nullable
public ParallelExecution.ParallelBatch<T,E> take()
                                                    throws InterruptedException,
                                                           IOException

Throws:

InterruptedException

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException