Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
108,094 visible repositories in the index
1–24 of 42 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Reactive Extensions for the Go language.
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
High-performance time-series aggregation for PostgreSQL
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
Open source framework for processing, monitoring, and alerting on time series data
YTsaurus is a scalable and fault-tolerant open-source big data platform.
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.
The Feldera Incremental Computation Engine
👜 Tiny and fast reactive/iterable programming library
Python Streaming DataFrames for Kafka
A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
Zero-cost & Type-safe Reactive Extensions for Rust. Supports both high-performance single-threaded (Local) and thread-safe (Shared) contexts. WASM & Tokio ready.
Esper Complex Event Processing, Streaming SQL and Event Series Analysis
Tenzir is the data pipeline engine for security teams.
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
Low-code tool for automating actions on real time data | Stream processing for the users.