Repository Index

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

• database
• stream-processing
• rust
• postgresql

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics

Upserts, Deletes And Incremental Processing on Big Data.

• hudi
• apachehudi
• datalake
• bigdata

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

• big-data
• data-ingestion
• flink
• paimon

A native Rust library for Delta Lake, with bindings into Python

• delta
• rust
• delta-lake
• databricks

An open lakehouse engine — Postgres-native, vector-native and Python-native. Speaks PostgreSQL, runs on your object storage, written in Rust.

• lakehouse
• spark
• flink
• streaming

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

• data
• spark
• java
• iceberg