org.apache.paimon.flink.clone

Class CloneFilesFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

org.apache.paimon.flink.clone.CloneProcessFunction<CloneFileInfo,DataFileInfo>

org.apache.paimon.flink.clone.CloneFilesFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class CloneFilesFunction
extends CloneProcessFunction<CloneFileInfo,DataFileInfo>

Clone files for table.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields inherited from class org.apache.paimon.flink.clone.CloneProcessFunction

dataFileSerializer, hiveCatalog, LOG, sourceCatalogConfig, tableCache, targetCatalog, targetCatalogConfig

Constructor Summary

Constructors

Constructor and Description
CloneFilesFunction(Map<String,String> sourceCatalogConfig, Map<String,String> targetCatalogConfig)

Method Summary

Modifier and Type	Method and Description
void	open(org.apache.flink.configuration.Configuration conf) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	processElement(CloneFileInfo cloneFileInfo, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<DataFileInfo> collector)

Methods inherited from class org.apache.paimon.flink.clone.CloneProcessFunction

close, getTable, open

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CloneFilesFunction

public CloneFilesFunction(Map<String,String> sourceCatalogConfig,
                          Map<String,String> targetCatalogConfig)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration conf)
          throws Exception

Description copied from class: CloneProcessFunction

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class CloneProcessFunction<CloneFileInfo,DataFileInfo>

Throws:

Exception

processElement

public void processElement(CloneFileInfo cloneFileInfo,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<DataFileInfo> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<CloneFileInfo,DataFileInfo>

Throws:

Exception