Roadmap

Roadmap #

Paimon’s long-term goal is to become the better data lake platform for building the Streaming Lakehouse. Paimon will invest in real-time, ecology, and data warehouse integrity for a long time.

If you have other requirements, please contact us.

What’s Next? #

Core #

  • Foreign Key Join Partial-Update
  • Append table supports batch / streaming z-order sort
  • Supports cross partition update

Compute Engines #

  • More management via Flink/Spark CALL procedures
  • Flink Sink supports at-least-once / unaligned checkpoint
  • Flink Whole database compaction Job
  • Public Spark Schema Evolution Pipeline
  • Spark supports Dynamic Partition overwrite
Edit This Page
Apache Paimon is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
Copyright © 2023 The Apache Software Foundation. Apache Paimon, Paimon, and its feather logo are trademarks of The Apache Software Foundation.