Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
77,353 visible repositories in the index
1–23 of 23 · Most stars
Apache Flink
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
- fluentd
- c
- logging
- data-collector
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Distributed stream processing engine in Rust
- data
- dev-tools
- infrastructure
- kafka
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
High-performance time-series aggregation for PostgreSQL
- realtime
- stream-processing
- analytics
- sql
YTsaurus is a scalable and fault-tolerant open-source big data platform.
- big-data
- clickhouse
- distributed-database
- lakehouse
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- sql
- redpanda
- single-binary
The Feldera Incremental Computation Engine
基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法
基于flink的实时流计算web平台
Lightweight data stream processing engine for IoT edge
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
Esper Complex Event Processing, Streaming SQL and Event Series Analysis
- cep
- complex-event-processing
- open-source
- compiler
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
- golang
- event-sourcing
- stream-processing
- brokers
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
The database purpose-built for stream processing applications.
- stream-processing
- real-time
- sql
- interactive
Lightweight SQL-based stream processing engine for IoT edge.
Open-source streaming SQL engine written in Rust using Apache Arrow and DataFusion. Supports continuous queries, temporal stream joins, tumbling/session windows, and CDC/Kafka connectors. Lightweight, embeddable, and sub-microsecond latency
The repository host gives no description.