Skip to main content

REST Catalog

The REST Catalog is a Paimon catalog client that talks to a remote service over HTTP. The service implements the REST Catalog API and owns the backend-specific catalog logic. Compute engines use the client to discover tables and perform catalog operations.

The engine sends catalog requests to a REST service, which manages catalog metadata. The engine reads and writes data files through the storage implementation.

How It Works​

  1. The client connects to the service URI and identifies the warehouse to use.
  2. The service authenticates requests and handles database, table, and other supported metadata operations.
  3. The client obtains table metadata and accesses files through the configured filesystem or object store. When supported and enabled, the service can provide temporary data-access credentials.

The catalog service does not need to proxy the contents of every data file. Catalog API access and storage access are separate parts of the connection. Server capabilities determine which optional table, permission, policy, and snapshot operations are available.

Connect an Engine​

Configure metastore = rest, the service uri, the warehouse, and an authentication provider. For REST Catalog, the warehouse identifies the server-side catalog or instance; use the value expected by your service rather than assuming it is a filesystem path.

Choose the authentication guide for your service:

ProviderGuide
Bearer token (token.provider = bear)Bearer Token, including a Flink SQL catalog example
Alibaba Cloud DLF (token.provider = dlf)DLF Token, including access keys, STS, and ECS roles

Work with Tables and Files​

TaskGuide
Understand Paimon Tables, Format Tables, and Object TablesTables
Access files using catalog, database, and table namesPaimon Virtual Storage
Use the catalog from JavaREST Java API

API References​

These references describe the client/server contracts. Check that your server implements an operation before relying on it.