org.apache.paimon.flink.clone.hive

Class ListHiveFilesFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

org.apache.paimon.flink.clone.hive.CopyProcessFunction<org.apache.flink.api.java.tuple.Tuple2<Identifier,Identifier>,CloneFileInfo>

org.apache.paimon.flink.clone.hive.ListHiveFilesFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class ListHiveFilesFunction
extends CopyProcessFunction<org.apache.flink.api.java.tuple.Tuple2<Identifier,Identifier>,CloneFileInfo>

List files for table.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields inherited from class org.apache.paimon.flink.clone.hive.CopyProcessFunction

dataFileSerializer, hiveCatalog, sourceCatalogConfig, tableCache, targetCatalog, targetCatalogConfig

Constructor Summary

Constructors

Constructor and Description
ListHiveFilesFunction(Map<String,String> sourceCatalogConfig, Map<String,String> targetCatalogConfig, String whereSql)

Method Summary

Modifier and Type	Method and Description
static PartitionPredicate	getPartitionPredicate(String whereSql, RowType partitionType, Identifier tableId)
void	processElement(org.apache.flink.api.java.tuple.Tuple2<Identifier,Identifier> tuple, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<CloneFileInfo> collector)

Methods inherited from class org.apache.paimon.flink.clone.hive.CopyProcessFunction

close, getTable, open

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ListHiveFilesFunction

public ListHiveFilesFunction(Map<String,String> sourceCatalogConfig,
                             Map<String,String> targetCatalogConfig,
                             @Nullable
                             String whereSql)

Method Detail

processElement

public void processElement(org.apache.flink.api.java.tuple.Tuple2<Identifier,Identifier> tuple,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<CloneFileInfo> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<org.apache.flink.api.java.tuple.Tuple2<Identifier,Identifier>,CloneFileInfo>

Throws:

Exception

getPartitionPredicate

@VisibleForTesting
 @Nullable
public static PartitionPredicate getPartitionPredicate(@Nullable
                                                                                     String whereSql,
                                                                                     RowType partitionType,
                                                                                     Identifier tableId)
                                                                              throws Exception

Throws:

Exception