Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Repository Index
47,133 repositories indexed
1–9 of 9 · Most stars
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Distributed stream processing engine in Rust
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
- csv
- data-wrangling
- opendata
- data-engineering
Apache DataFusion Ballista Distributed Query Engine
- arrow
- big-data
- dataframe
- olap
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
Apache Spark Connect Client for Rust
- grpc-client
- spark
- spark-connect
- spark-sql
Open-source streaming SQL engine written in Rust using Apache Arrow and DataFusion. Supports continuous queries, temporal stream joins, tumbling/session windows, and CDC/Kafka connectors. Lightweight, embeddable, and sub-microsecond latency