Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
56,139 visible repositories in the index
1–24 of 32 · Most stars
Apache Flink
Building event-driven applications the easy way in Go.
- watermill
- event-driven
- event-sourcing
- sagas
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
- cloud-native
- streaming
- rust
- real-time
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
- akka
- actor-model
- dotnet
- concurrency
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
- flogo
- iot
- integration
- golang
Compositional, streaming I/O library for Scala
- scala
- stream
- streaming-computation
- fp
👜 Tiny and fast reactive/iterable programming library
- callbacks
- reactive
- iterables
- observables
Probabilistic data structures for processing continuous, unbounded streams.
- bloom-filter
- go
- stable-bloom-filters
- cuckoo-filter
Python Streaming DataFrames for Kafka
A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
- change-data-capture
- data
- data-collection
- data-engineering
Mirror of Apache Samza
- scala
- big-data
- samza
Tenzir is the data pipeline engine for security teams.
- incident-response
- threathunting
- siem
- soc
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
Lightweight real-time big data streaming engine over Apache Pekko
- akka
- stream-processing
- bigdata
- scala
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications
- event-driven
- generics
- go
- golang
A stream processing framework to build stateless applications on Kafka
- kafka-streams
- clojure
- framework
The database purpose-built for stream processing applications.
- stream-processing
- real-time
- sql
- interactive