Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Repository Index
47,133 repositories indexed
1–24 of 33 · Most stars
A high-performance observability data pipeline.
QuestDB is a high performance, open-source, time-series database
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
A curated list of awesome big data frameworks, ressources and other awesomeness.
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
A curated list of awesome System Design (A.K.A. Distributed Systems) resources.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Fancy stream processing made operationally mundane
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Upserts, Deletes And Incremental Processing on Big Data.
🌊 Online machine learning in Python
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Distributed stream processing engine in Rust
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Kubernetes-native platform to run massively parallel data/streaming jobs
A lightweight stream processing library for Go
Python Stream Processing
Stream Processing and Complex Event Processing Engine
Python Streaming DataFrames for Kafka
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
Lightweight real-time big data streaming engine over Apache Pekko
Low-code tool for automating actions on real time data | Stream processing for the users.