Skip to main content

Multimodal API

pypaimon.multimodal provides a compact interface for scalar, text, vector, and BLOB data on Paimon data-evolution tables without primary keys. A connection wraps a catalog and a default database.

Start with Multimodal Tables to connect, define a schema, and add rows. Then follow the guide for your workload:

TaskGuide
Create or change rowsMultimodal tables
Read payloads and coordinate jobsMultimodal reads and row IDs
Retrieve text and vector candidatesSearch
Store mediaBLOB storage, object API, video frames
Import robotics datasetsHDF5 and ROSBag, LeRobot
Update selected columnsData evolution
Train and process dataPyTorch, Ray Data, Daft

Create and modify tables​

Connect to a catalog, define scalar and payload columns, add rows, and apply overwrite, update, delete, or merge operations.

Read the guide.

Read rows and payloads​

Filter and project rows, read BLOBs in batches, build training windows, and pass row IDs between retrieval and processing stages.

Read the guide.

Search text and vectors​

Create indexes and run single-vector, full-text, hybrid, or batch-vector queries. Includes pre-filter and result-filter semantics.

Read the guide.

Store video frames​

Write complete encoded videos with logical frame rows, replace a video payload, and decode frames in a PyTorch DataLoader.

Read the guide.

Import HDF5 and ROSBag​

Transform local or remote HDF5 and ROSBag sources into table rows, with source-specific options and distributed ingestion paths.

Read the guide.

Work with LeRobot​

Import Dataset v3, capture frame data directly, retain component tags, and train from a complete Paimon table group.

Read the guide.

Use the BLOB object API​

Put, read, delete, and update objects using table columns as keys and payloads. For the lower-level storage API, see BLOB Storage.

Read the guide.