org.apache.paimon.flink.clone.hive

Class CopyProcessFunction<I,O>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

org.apache.paimon.flink.clone.hive.CopyProcessFunction<I,O>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

Direct Known Subclasses:

CopyHiveFilesFunction, ListHiveFilesFunction

public abstract class CopyProcessFunction<I,O>
extends org.apache.flink.streaming.api.functions.ProcessFunction<I,O>

Abstract function for copying tables.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields

Modifier and Type	Field and Description
protected DataFileMetaSerializer	dataFileSerializer
protected HiveCatalog	hiveCatalog
protected Map<String,String>	sourceCatalogConfig
protected Map<Identifier,Table>	tableCache
protected Catalog	targetCatalog
protected Map<String,String>	targetCatalogConfig

Constructor Summary

Constructors

Constructor and Description
CopyProcessFunction(Map<String,String> sourceCatalogConfig, Map<String,String> targetCatalogConfig)

Method Summary

Modifier and Type	Method and Description
void	close()
protected Table	getTable(Identifier identifier)
void	open(OpenContext openContext)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer, processElement

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sourceCatalogConfig

protected final Map<String,String> sourceCatalogConfig

targetCatalogConfig

protected final Map<String,String> targetCatalogConfig

hiveCatalog

protected transient HiveCatalog hiveCatalog

targetCatalog

protected transient Catalog targetCatalog

tableCache

protected transient Map<Identifier,Table> tableCache

dataFileSerializer

protected transient DataFileMetaSerializer dataFileSerializer

Constructor Detail

CopyProcessFunction

public CopyProcessFunction(Map<String,String> sourceCatalogConfig,
                           Map<String,String> targetCatalogConfig)

Method Detail

open

public void open(OpenContext openContext)
          throws Exception

Throws:

Exception

getTable

protected Table getTable(Identifier identifier)

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception