org.apache.paimon.flink.lookup

Class FileStoreLookupFunction

java.lang.Object

org.apache.paimon.flink.lookup.FileStoreLookupFunction

All Implemented Interfaces:

Closeable, Serializable, AutoCloseable

public class FileStoreLookupFunction
extends Object
implements Serializable, Closeable

A lookup TableFunction for file store.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.flink.table.functions.FunctionContext	functionContext

Constructor Summary

Constructors

Constructor and Description
FileStoreLookupFunction(Table table, int[] projection, int[] joinKeyIndex, Predicate predicate)

Method Summary

Modifier and Type	Method and Description
void	close()
protected Set<Integer>	getRequireCachedBucketIds() Get the set of bucket IDs that need to be cached by the current lookup join subtask.
Collection<org.apache.flink.table.data.RowData>	lookup(org.apache.flink.table.data.RowData keyRow)
void	open(org.apache.flink.table.functions.FunctionContext context)
protected void	setCacheRowFilter(Filter<InternalRow> cacheRowFilter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

functionContext

protected org.apache.flink.table.functions.FunctionContext functionContext

Constructor Detail

FileStoreLookupFunction

public FileStoreLookupFunction(Table table,
                               int[] projection,
                               int[] joinKeyIndex,
                               @Nullable
                               Predicate predicate)

Method Detail

open

public void open(org.apache.flink.table.functions.FunctionContext context)
          throws Exception

Throws:

Exception

lookup

public Collection<org.apache.flink.table.data.RowData> lookup(org.apache.flink.table.data.RowData keyRow)

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

getRequireCachedBucketIds

protected Set<Integer> getRequireCachedBucketIds()

Get the set of bucket IDs that need to be cached by the current lookup join subtask.

The Flink Planner will distribute data to lookup join nodes based on buckets. This allows paimon to cache only the necessary buckets for each subtask, improving efficiency.

Returns:

the set of bucket IDs to be cached

setCacheRowFilter

protected void setCacheRowFilter(@Nullable
                                 Filter<InternalRow> cacheRowFilter)