Fancy stream processing made operationally mundane
- message-queue
- stream-processing
- streaming-data
- message-bus
Repository Index
72,862 visible repositories in the index
1–24 of 27 · Most stars
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
- fluentd
- c
- logging
- data-collector
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
- cloud-native
- streaming
- rust
- real-time
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
- akka
- actor-model
- dotnet
- concurrency
Distributed stream processing engine in Rust
- data
- dev-tools
- infrastructure
- kafka
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
- security
- kinesis
- serverless
- terraform
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
- flogo
- iot
- integration
- golang
Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.
- benthos
- bento
- connect
- connectors
A lightweight stream processing library for Go
The Feldera Incremental Computation Engine
Probabilistic data structures for processing continuous, unbounded streams.
- bloom-filter
- go
- stable-bloom-filters
- cuckoo-filter
A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
Trill is a single-node query processor for temporal or streaming data.
- streaming-data
- temporal-data
Tenzir is the data pipeline engine for security teams.
- incident-response
- threathunting
- siem
- soc
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications
- event-driven
- generics
- go
- golang
Machine is a workflow/pipeline library for processing data
- golang
- golang-library
- golang-package
- workflow
Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.
Real-time decision features without streaming infra. Turn live events into product reflexes — no Kafka, no Flink, no feature store.
- analytics
- feature-store
- fraud-detection
- python
Small, Fast event processing and monitoring for Erlang/OTP applications.