Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
81,588 visible repositories in the index
1–24 of 67 · Most stars
Building event-driven applications the easy way in Go.
- watermill
- event-driven
- event-sourcing
- sagas
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Fancy stream processing made operationally mundane
- message-queue
- stream-processing
- streaming-data
- message-bus
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
- fluentd
- c
- logging
- data-collector
The Reactive Extensions for .NET
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
- rule-engine
- java
- dmn
- hacktoberfest
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
- cloud-native
- streaming
- rust
- real-time
Reactive Extensions for the Go language.
- reactivex
- golang
- observable
- go
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
- akka
- actor-model
- dotnet
- concurrency
Distributed stream processing engine in Rust
- data
- dev-tools
- infrastructure
- kafka
A network event stream processing system, in Clojure.
- riemann
- events
- clojure
- monitoring
A modular implementation of timely dataflow in Rust
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
An implementation of differential dataflow using timely dataflow on Rust.
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
- security
- kinesis
- serverless
- terraform
Concurrent and multi-stage data ingestion and data processing with Elixir
- elixir
- genstage
- data-ingestion
- data-processing
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
- goka
- stream
- processing
- kafka
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
- flogo
- iot
- integration
- golang
Open source framework for processing, monitoring, and alerting on time series data
- kapacitor
- monitoring
- time-series
YTsaurus is a scalable and fault-tolerant open-source big data platform.
- big-data
- clickhouse
- distributed-database
- lakehouse
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- sql
- redpanda
- single-binary