Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
142,187 visible repositories in the index
1–24 of 44 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
Apache Flink
Building event-driven applications the easy way in Go.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache Storm
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Fast web applications through dynamic, partially-stateful dataflow
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Kubernetes-native platform to run massively parallel data/streaming jobs
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
Open source framework for processing, monitoring, and alerting on time series data
YTsaurus is a scalable and fault-tolerant open-source big data platform.
Ruby and Rails efficient Kafka processing framework
A lightweight stream processing library for Go
Python Streaming DataFrames for Kafka
Distributed Stream Processing
A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
The Data Change Processing platform
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊