org.apache.paimon.flink.compact

Class MultiTableScanBase<T>

java.lang.Object

org.apache.paimon.flink.compact.MultiTableScanBase<T>

Type Parameters:

T - the result of scanning file :

1. Tuple2<Split,String> for the table with multi buckets, such as dynamic or fixed bucket table.
2. MultiTableUnawareAppendCompactionTask for the table witch fixed single bucket ,such as unaware bucket table.

All Implemented Interfaces:

AutoCloseable

Direct Known Subclasses:

MultiAwareBucketTableScan, MultiUnawareBucketTableScan

public abstract class MultiTableScanBase<T>
extends Object
implements AutoCloseable

This class is responsible for implementing the scanning logic for the table of different type buckets during compaction.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MultiTableScanBase.ScanResult the result of table scanning.

Field Summary

Fields

Modifier and Type	Field and Description
protected Catalog	catalog
protected Pattern	databasePattern
protected Pattern	excludingPattern
protected Pattern	includingPattern
protected AtomicBoolean	isRunning
protected boolean	isStreaming

Constructor Summary

Constructors

Constructor and Description
MultiTableScanBase(Catalog.Loader catalogLoader, Pattern includingPattern, Pattern excludingPattern, Pattern databasePattern, boolean isStreaming, AtomicBoolean isRunning)

Method Summary

Modifier and Type	Method and Description
void	close()
MultiTableScanBase.ScanResult	scanTable(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> ctx)
protected void	updateTableMap()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

includingPattern

protected final Pattern includingPattern

excludingPattern

protected final Pattern excludingPattern

databasePattern

protected final Pattern databasePattern

catalog

protected transient Catalog catalog

isRunning

protected AtomicBoolean isRunning

isStreaming

protected boolean isStreaming

Constructor Detail

MultiTableScanBase

public MultiTableScanBase(Catalog.Loader catalogLoader,
                          Pattern includingPattern,
                          Pattern excludingPattern,
                          Pattern databasePattern,
                          boolean isStreaming,
                          AtomicBoolean isRunning)

Method Detail

updateTableMap

protected void updateTableMap()
                       throws Catalog.DatabaseNotExistException,
                              Catalog.TableNotExistException

Throws:

Catalog.DatabaseNotExistException

Catalog.TableNotExistException

scanTable

public MultiTableScanBase.ScanResult scanTable(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> ctx)
                                        throws Catalog.TableNotExistException,
                                               Catalog.DatabaseNotExistException

Throws:

Catalog.TableNotExistException

Catalog.DatabaseNotExistException

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception