org.apache.paimon.hive.migrate

Class HiveMigrator

java.lang.Object

org.apache.paimon.hive.migrate.HiveMigrator

All Implemented Interfaces:

Migrator

public class HiveMigrator
extends Object
implements Migrator

Migrate hive table to paimon table.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HiveMigrator.MigrateTask One import task for one partition.

Constructor Summary

Constructors

Constructor and Description
HiveMigrator(HiveCatalog hiveCatalog, String sourceDatabase, String sourceTable, String targetDatabase, String targetTable, Integer parallelism, Map<String,String> options)

Method Summary

Modifier and Type	Method and Description
static List<Migrator>	databaseMigrators(HiveCatalog hiveCatalog, String sourceDatabase, Map<String,String> options, Integer parallelism)
void	deleteOriginTable(boolean deleteOriginTable)
void	executeMigrate()
Schema	from(List<org.apache.hadoop.hive.metastore.api.FieldSchema> fields, List<org.apache.hadoop.hive.metastore.api.FieldSchema> partitionFields, Map<String,String> hiveTableOptions)
HiveMigrator.MigrateTask	importUnPartitionedTableTask(FileIO fileIO, org.apache.hadoop.hive.metastore.api.Table sourceTable, FileStoreTable paimonTable, Map<Path,Path> rollback)
void	renameTable(boolean ignoreIfNotExists)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveMigrator

public HiveMigrator(HiveCatalog hiveCatalog,
                    String sourceDatabase,
                    String sourceTable,
                    String targetDatabase,
                    String targetTable,
                    Integer parallelism,
                    Map<String,String> options)

Method Detail

databaseMigrators

public static List<Migrator> databaseMigrators(HiveCatalog hiveCatalog,
                                               String sourceDatabase,
                                               Map<String,String> options,
                                               Integer parallelism)

deleteOriginTable

public void deleteOriginTable(boolean deleteOriginTable)

Specified by:

deleteOriginTable in interface Migrator

executeMigrate

public void executeMigrate()
                    throws Exception

Specified by:

executeMigrate in interface Migrator

Throws:

Exception

renameTable

public void renameTable(boolean ignoreIfNotExists)
                 throws Exception

Specified by:

renameTable in interface Migrator

Throws:

Exception

from

public Schema from(List<org.apache.hadoop.hive.metastore.api.FieldSchema> fields,
                   List<org.apache.hadoop.hive.metastore.api.FieldSchema> partitionFields,
                   Map<String,String> hiveTableOptions)

importUnPartitionedTableTask

public HiveMigrator.MigrateTask importUnPartitionedTableTask(FileIO fileIO,
                                                             org.apache.hadoop.hive.metastore.api.Table sourceTable,
                                                             FileStoreTable paimonTable,
                                                             Map<Path,Path> rollback)