Apache Paimon

Data Lake Platform — unified batch, streaming, and multimodal AI in a single lake format.

📊 Large-Scale Analytics

Petabyte-scale tables with time travel, fast scan planning, schema evolution, and incremental clustering.

Append-only tables, incremental clustering, and streaming append

Quick start, SQL operations, DataFrames, structured streaming

Snapshots, tags, metrics, compaction, and performance tuning

⚡ Realtime Streaming

LSM-powered streaming updates with multiple merge engines and changelog producers.

Merge engines, changelog producers, compaction, and streaming updates

Quick start, SQL DDL/DML, streaming read & write, procedures

MySQL, PostgreSQL, Kafka, MongoDB, Pulsar CDC pipelines

🧠 Multimodal AI

Vector search, full-text search, blob tables, and native Python SDK for ML pipelines.

Data evolution, blob storage, vector storage, and global index

Python SDK, Ray, PyTorch, Pandas integration for AI & multimodal workloads

StarRocks, Doris, Hive, Trino, Presto integrations