org.apache.paimon.utils

Class ManifestReadThreadPool

java.lang.Object

org.apache.paimon.utils.ManifestReadThreadPool

public class ManifestReadThreadPool
extends Object

Thread pool to read manifests.

Constructor Summary

Constructors

Constructor and Description
ManifestReadThreadPool()

Method Summary

Modifier and Type	Method and Description
static ThreadPoolExecutor	getExecutorService(Integer threadNum)
static <T,U> Iterator<T>	randomlyExecute(java.util.function.Function<U,List<T>> processor, List<U> input, Integer threadNum) This method aims to parallel process tasks with randomly but return values sequentially.
static <T,U> Iterable<T>	sequentialBatchedExecute(java.util.function.Function<U,List<T>> processor, List<U> input, Integer threadNum) This method aims to parallel process tasks with memory control and sequentially.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ManifestReadThreadPool

public ManifestReadThreadPool()

Method Detail

getExecutorService

public static ThreadPoolExecutor getExecutorService(@Nullable
                                                    Integer threadNum)

sequentialBatchedExecute

public static <T,U> Iterable<T> sequentialBatchedExecute(java.util.function.Function<U,List<T>> processor,
                                                         List<U> input,
                                                         @Nullable
                                                         Integer threadNum)

This method aims to parallel process tasks with memory control and sequentially.

randomlyExecute

public static <T,U> Iterator<T> randomlyExecute(java.util.function.Function<U,List<T>> processor,
                                                List<U> input,
                                                @Nullable
                                                Integer threadNum)

This method aims to parallel process tasks with randomly but return values sequentially.