This documentation is for an unreleased version of Apache Paimon. We recommend you use the latest stable version.
Hive Catalogs
Hive Catalog #
When creating Paimon table, set 'metadata.iceberg.storage' = 'hive-catalog'.
This option value not only store Iceberg metadata like hadoop-catalog, but also create Iceberg external table in Hive.
This Paimon table can be accessed from Iceberg Hive catalog later.
To provide information about Hive metastore, you also need to set some (or all) of the following table options when creating Paimon table.
| Option | Default | Type | Description |
|---|---|---|---|
metadata.iceberg.uri |
String | Hive metastore uri for Iceberg Hive catalog. | |
metadata.iceberg.hive-conf-dir |
String | hive-conf-dir for Iceberg Hive catalog. | |
metadata.iceberg.hadoop-conf-dir |
String | hadoop-conf-dir for Iceberg Hive catalog. | |
metadata.iceberg.manifest-compression |
snappy | String | Compression for Iceberg manifest files. |
metadata.iceberg.manifest-legacy-version |
false | Boolean | Should use the legacy manifest version to generate Iceberg's 1.4 manifest files. |
metadata.iceberg.hive-client-class |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient | String | Hive client class name for Iceberg Hive Catalog. |
metadata.iceberg.glue.skip-archive |
false | Boolean | Skip archive for AWS Glue catalog. |
metadata.iceberg.hive-skip-update-stats |
false | Boolean | Skip updating Hive stats. |
AWS Glue Catalog #
You can use Hive Catalog to connect AWS Glue metastore, you can use set 'metadata.iceberg.hive-client-class' to
'com.amazonaws.glue.catalog.metastore.AWSCatalogMetastoreClient'.
Note: You can use this repo to build the required jar, include it in your path and configure the AWSCatalogMetastoreClient.