org.apache.paimon.flink.clone

Class CopyMetaFilesForCloneOperator

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<org.apache.flink.api.java.tuple.Tuple2<String,String>,Void>

org.apache.paimon.flink.clone.CopyMetaFilesForCloneOperator

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class CopyMetaFilesForCloneOperator
extends org.apache.flink.streaming.api.functions.ProcessFunction<org.apache.flink.api.java.tuple.Tuple2<String,String>,Void>

Copy the meta files of a table for clone operation. and output the index files and data manifest files of the table to the next operator.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.flink.util.OutputTag<CloneFileInfo>	DATA_MANIFEST_FILES_TAG
static org.apache.flink.util.OutputTag<CloneFileInfo>	INDEX_FILES_TAG

Constructor Summary

Constructors

Constructor and Description
CopyMetaFilesForCloneOperator(Map<String,String> sourceCatalogConfig, Map<String,String> targetCatalogConfig)

Method Summary

Modifier and Type	Method and Description
void	close()
void	open(OpenContext openContext)
void	processElement(org.apache.flink.api.java.tuple.Tuple2<String,String> tuple, org.apache.flink.streaming.api.functions.ProcessFunction.Context context, org.apache.flink.util.Collector<Void> collector)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

INDEX_FILES_TAG

public static final org.apache.flink.util.OutputTag<CloneFileInfo> INDEX_FILES_TAG

DATA_MANIFEST_FILES_TAG

public static final org.apache.flink.util.OutputTag<CloneFileInfo> DATA_MANIFEST_FILES_TAG

Constructor Detail

CopyMetaFilesForCloneOperator

public CopyMetaFilesForCloneOperator(Map<String,String> sourceCatalogConfig,
                                     Map<String,String> targetCatalogConfig)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Throws:

Exception

processElement

public void processElement(org.apache.flink.api.java.tuple.Tuple2<String,String> tuple,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context context,
                           org.apache.flink.util.Collector<Void> collector)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<org.apache.flink.api.java.tuple.Tuple2<String,String>,Void>

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception