org.apache.paimon.flink.clone

Class CloneProcessFunction<I,O>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

org.apache.paimon.flink.clone.CloneProcessFunction<I,O>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

Direct Known Subclasses:

CloneFilesFunction, ListCloneFilesFunction

public abstract class CloneProcessFunction<I,O>
extends org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

Abstract function for copying tables.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields

Modifier and Type	Field and Description
protected DataFileMetaSerializer	dataFileSerializer
protected HiveCatalog	hiveCatalog
protected static org.slf4j.Logger	LOG
protected Map<String,String>	sourceCatalogConfig
protected Map<Identifier,Table>	tableCache
protected Catalog	targetCatalog
protected Map<String,String>	targetCatalogConfig

Constructor Summary

Constructors

Constructor and Description
CloneProcessFunction(Map<String,String> sourceCatalogConfig, Map<String,String> targetCatalogConfig)

Method Summary

Modifier and Type	Method and Description
void	close()
protected Table	getTable(Identifier identifier)
void	open(org.apache.flink.configuration.Configuration conf) Do not annotate with @override here to maintain compatibility with Flink 2.0+.
void	open(OpenContext openContext) Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer, processElement

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

sourceCatalogConfig

protected final Map<String,String> sourceCatalogConfig

targetCatalogConfig

protected final Map<String,String> targetCatalogConfig

hiveCatalog

protected transient HiveCatalog hiveCatalog

targetCatalog

protected transient Catalog targetCatalog

tableCache

protected transient Map<Identifier,Table> tableCache

dataFileSerializer

protected transient DataFileMetaSerializer dataFileSerializer

Constructor Detail

CloneProcessFunction

public CloneProcessFunction(Map<String,String> sourceCatalogConfig,
                            Map<String,String> targetCatalogConfig)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 1.18-.

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration conf)
          throws Exception

Do not annotate with @override here to maintain compatibility with Flink 2.0+.

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

getTable

protected Table getTable(Identifier identifier)

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception