Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Repository Index
142,273 visible repositories in the index
1–7 of 7 · Most stars
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
- machine-learning
- computer-vision
- data-format
- deep-learning
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
DuckLake is an integrated data lake and catalog format
Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
- apache-hudi
- apache-iceberg
- delta-lake
Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
- apache-iceberg
- apache-spark
- data-engineering
- delta-lake