org.apache.paimon.lineage

Interface LineageMeta

All Superinterfaces:

AutoCloseable

public interface LineageMeta
extends AutoCloseable

Metadata store will manage table lineage and data lineage information for the catalog.

Method Summary

Modifier and Type	Method and Description
void	deleteSinkTableLineage(String job) Delete the sink table lineage for given job.
void	deleteSourceTableLineage(String job) Delete the source table lineage for given job.
void	saveSinkDataLineage(DataLineageEntity entity) Save the sink table and job lineage.
void	saveSinkTableLineage(TableLineageEntity entity) Save the sink table and job lineage.
void	saveSourceDataLineage(DataLineageEntity entity) Save the source table and job lineage.
void	saveSourceTableLineage(TableLineageEntity entity) Save the source table and job lineage.
Iterator<DataLineageEntity>	sinkDataLineages(Predicate predicate) Get sink data and job lineages.
Iterator<TableLineageEntity>	sinkTableLineages(Predicate predicate) Get sink table and job lineages.
Iterator<DataLineageEntity>	sourceDataLineages(Predicate predicate) Get source data and job lineages.
Iterator<TableLineageEntity>	sourceTableLineages(Predicate predicate) Get source table and job lineages.

Methods inherited from interface java.lang.AutoCloseable

close

Method Detail

saveSourceTableLineage

void saveSourceTableLineage(TableLineageEntity entity)

Save the source table and job lineage.

Parameters:

entity - the table lineage entity

deleteSourceTableLineage

void deleteSourceTableLineage(String job)

Delete the source table lineage for given job.

Parameters:

job - the job for table lineage

sourceTableLineages

Iterator<TableLineageEntity> sourceTableLineages(@Nullable
                                                 Predicate predicate)

Get source table and job lineages.

Parameters:

predicate - the predicate for the table lineages

Returns:

the iterator for source table and job lineages

saveSinkTableLineage

void saveSinkTableLineage(TableLineageEntity entity)

Save the sink table and job lineage.

Parameters:

entity - the table lineage entity

sinkTableLineages

Iterator<TableLineageEntity> sinkTableLineages(@Nullable
                                               Predicate predicate)

Get sink table and job lineages.

Parameters:

predicate - the predicate for the table lineages

Returns:

the iterator for sink table and job lineages

deleteSinkTableLineage

void deleteSinkTableLineage(String job)

Delete the sink table lineage for given job.

Parameters:

job - the job for table lineage

saveSourceDataLineage

void saveSourceDataLineage(DataLineageEntity entity)

Save the source table and job lineage.

Parameters:

entity - the data lineage entity

sourceDataLineages

Iterator<DataLineageEntity> sourceDataLineages(@Nullable
                                               Predicate predicate)

Get source data and job lineages.

Parameters:

predicate - the predicate for the table lineages

Returns:

the iterator for source table and job lineages

saveSinkDataLineage

void saveSinkDataLineage(DataLineageEntity entity)

Save the sink table and job lineage.

Parameters:

entity - the data lineage entity

sinkDataLineages

Iterator<DataLineageEntity> sinkDataLineages(@Nullable
                                             Predicate predicate)

Get sink data and job lineages.

Parameters:

predicate - the predicate for the table lineages

Returns:

the iterator for sink table and job lineages