Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more
Repository Index
142,273 visible repositories in the index
1–24 of 33 · Most stars
Python Stream Processing
- kafka-streams
- kafka
- python
- asyncio
Apache Storm
- storm
- apache
- distributed
- streaming
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
- cloud-native
- streaming
- rust
- real-time
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
- akka
- actor-model
- dotnet
- concurrency
Distributed stream processing engine in Rust
- data
- dev-tools
- infrastructure
- kafka
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
- goka
- stream
- processing
- kafka
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
YTsaurus is a scalable and fault-tolerant open-source big data platform.
- big-data
- clickhouse
- distributed-database
- lakehouse
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- sql
- redpanda
- single-binary
The Feldera Incremental Computation Engine
Python Stream Processing. A Faust fork
Lightweight data stream processing engine for IoT edge
A Rust framework for correct and performant distributed systems
- distributed-systems
- rust
Distributed Stream Processing
- stream-processing
- stream-processor
- stream-processing-engine
- pony-language
A compatibility layer for event-driven abstractions
- stream-processing
- future
- clojure
- async
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Streaming reactive and dataflow graphs in Python
- python
- python3
- stream
- data-pipeline
The database purpose-built for stream processing applications.
- stream-processing
- real-time
- sql
- interactive
Real-time decision features without streaming infra. Turn live events into product reflexes — no Kafka, no Flink, no feature store.
- analytics
- feature-store
- fraud-detection
- python