Overview #
Paimon not only supports Flink SQL writes and queries natively, but also provides queries from other popular engines, such as Apache Spark and Apache Hive.
Compatibility Matrix #
Engine | Version | Batch Read | Batch Write | Create Table | Streaming Write | Streaming Read | Batch Overwrite |
---|---|---|---|---|---|---|---|
Flink | 1.14 - 1.17 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
Hive | 2.1 - 3.1 | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
Spark | 3.1 - 3.4 | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ |
Spark | 2.4 | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
Trino | 358 - 400 | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
Presto | 0.236 - 0.279 | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
Ongoing engines:
- Doris: Under development, Support Paimon catalog, Doris Roadmap 2023.
- Seatunnel: Under development, Introduce paimon connector.
- Starrocks: Under discussion