Roadmap #

Paimon’s long-term goal is to become the better data lake platform for building the Streaming Lakehouse. Paimon will invest in real-time, ecology, and data warehouse integrity for a long time.

If you have other requirements, please contact us.

What’s Next? #

Core #

• Lookup Changelog-Producer to produce changelog in real-time
• Enhance Flink Lookup Join from True Lookup
• Provide stable Java Programing API
• Savepoint support
• More Metrics, such as the busyness of compaction thread
• Multi table consistency for real-time materialized views

Ingestion #

• Schema Evolution Synchronization from Flink CDC
• Entire Database Synchronization from Flink CDC
• Integration with Apache Seatunnel

Compute Engines #

• Flink DELETE/UPDATE support
• More management via Flink/Spark CALL procedures.
• Hive Writer
• Spark Writer supports INSERT OVERWRITE
• Spark Time Traveling
• Presto Reader
• Doris Reader