org.apache.paimon.crosspartition

Interface ExistingProcessor

All Known Implementing Classes:

DeleteExistingProcessor, SkipNewExistingProcessor, UseOldExistingProcessor

public interface ExistingProcessor

Processor to process existing key.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	ExistingProcessor.SortOrder Input Order for sorting.

Method Summary

Modifier and Type	Method and Description
static void	bulkLoadCollectFirst(java.util.function.BiConsumer<InternalRow,Integer> collector, RowIterator iterator, java.util.function.Function<InternalRow,BinaryRow> extractPrimary, java.util.function.Function<InternalRow,BinaryRow> extractPartition, java.util.function.Function<BinaryRow,Integer> assignBucket)
void	bulkLoadNewRecords(java.util.function.Function<ExistingProcessor.SortOrder,RowIterator> iteratorFunction, java.util.function.Function<InternalRow,BinaryRow> extractPrimary, java.util.function.Function<InternalRow,BinaryRow> extractPartition, java.util.function.Function<BinaryRow,Integer> assignBucket)
static ExistingProcessor	create(CoreOptions.MergeEngine mergeEngine, ProjectToRowFunction setPartition, BucketAssigner bucketAssigner, java.util.function.BiConsumer<InternalRow,Integer> collector)
boolean	processExists(InternalRow newRow, BinaryRow previousPart, int previousBucket)

Method Detail

processExists

boolean processExists(InternalRow newRow,
                      BinaryRow previousPart,
                      int previousBucket)

Returns:

should process new record.

bulkLoadNewRecords

void bulkLoadNewRecords(java.util.function.Function<ExistingProcessor.SortOrder,RowIterator> iteratorFunction,
                        java.util.function.Function<InternalRow,BinaryRow> extractPrimary,
                        java.util.function.Function<InternalRow,BinaryRow> extractPartition,
                        java.util.function.Function<BinaryRow,Integer> assignBucket)

bulkLoadCollectFirst

static void bulkLoadCollectFirst(java.util.function.BiConsumer<InternalRow,Integer> collector,
                                 RowIterator iterator,
                                 java.util.function.Function<InternalRow,BinaryRow> extractPrimary,
                                 java.util.function.Function<InternalRow,BinaryRow> extractPartition,
                                 java.util.function.Function<BinaryRow,Integer> assignBucket)

create

static ExistingProcessor create(CoreOptions.MergeEngine mergeEngine,
                                ProjectToRowFunction setPartition,
                                BucketAssigner bucketAssigner,
                                java.util.function.BiConsumer<InternalRow,Integer> collector)