org.apache.paimon.crosspartition

Class SkipNewExistingProcessor

java.lang.Object

org.apache.paimon.crosspartition.SkipNewExistingProcessor

All Implemented Interfaces:

ExistingProcessor

public class SkipNewExistingProcessor
extends Object
implements ExistingProcessor

A ExistingProcessor to skip new record.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.paimon.crosspartition.ExistingProcessor

ExistingProcessor.SortOrder

Constructor Summary

Constructors

Constructor and Description
SkipNewExistingProcessor(java.util.function.BiConsumer<InternalRow,Integer> collector)

Method Summary

Modifier and Type	Method and Description
void	bulkLoadNewRecords(java.util.function.Function<ExistingProcessor.SortOrder,RowIterator> iteratorFunction, java.util.function.Function<InternalRow,BinaryRow> extractPrimary, java.util.function.Function<InternalRow,BinaryRow> extractPartition, java.util.function.Function<BinaryRow,Integer> assignBucket)
boolean	processExists(InternalRow newRow, BinaryRow previousPart, int previousBucket)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.paimon.crosspartition.ExistingProcessor

bulkLoadCollectFirst, create

Constructor Detail

SkipNewExistingProcessor

public SkipNewExistingProcessor(java.util.function.BiConsumer<InternalRow,Integer> collector)

Method Detail

processExists

public boolean processExists(InternalRow newRow,
                             BinaryRow previousPart,
                             int previousBucket)

Specified by:

processExists in interface ExistingProcessor

Returns:

should process new record.

bulkLoadNewRecords

public void bulkLoadNewRecords(java.util.function.Function<ExistingProcessor.SortOrder,RowIterator> iteratorFunction,
                               java.util.function.Function<InternalRow,BinaryRow> extractPrimary,
                               java.util.function.Function<InternalRow,BinaryRow> extractPartition,
                               java.util.function.Function<BinaryRow,Integer> assignBucket)

Specified by:

bulkLoadNewRecords in interface ExistingProcessor