Ranked by Attention Score: stars gained over the last 90 complete days
1–100 of 226 by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Cross-platform, customizable ML solutions for live and streaming media.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Apache Kafka - A distributed event streaming platform
Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed
Apache Spark - A unified analytics engine for large-scale data processing
Incremental engine for long horizon agents 🌟 Star if you like it!
High-Performance server for NATS.io, the cloud and edge native messaging system.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
Apache Doris is a real-time analytics and hybrid search database for AI agents.
An orchestration platform for the development, production, and observation of data assets.
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
The Data Engineering Cookbook
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Cloud-native OSS search engine for observability
QuestDB is a high performance, open-source, time-series database
KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
Always know what to expect from your data.
IM Chat OpenClaw
Workflow Engine for Kubernetes
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Efficient reliable UDP unicast, UDP multicast, and IPC message transport
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
The Open Source Feature Store for AI/ML
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Turns Data and AI algorithms into production-ready web applications in no time.
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
mall-swarm是一套微服务商城系统，采用了 Spring Cloud Alibaba、Spring Boot 3.5、Sa-Token、MyBatis、Elasticsearch、Docker、Kubernetes等核心技术，同时提供了基于Vue的管理后台方便快速搭建系统。mall-swarm在电商业务的基础集成了注册中心、配置中心、监控中心、网关等系统功能。
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
A distributed, fast open-source graph database featuring horizontal scalability and high availability
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
Upserts, Deletes And Incremental Processing on Big Data.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
Where data access meets operational intelligence
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
Open-Source Web UI for Apache Kafka Management
The most widely used Python to C compiler
Golang client for NATS, the cloud native messaging system.
Simple, secure & standards compliant web server for the most demanding of applications
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
Distributed stream processing engine in Rust
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Apache Pulsar - distributed pub-sub messaging system
Apache Beam is a unified programming model for Batch and Streaming data processing.
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
the portable Python dataframe library
The official home of the Presto distributed SQL query engine for big data
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
The open source, cloud native tool for API Mocking and Testing. Microcks is a Cloud Native Computing Foundation incubating project 🚀
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Eclipse iceoryx™ - true zero-copy inter-process-communication
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Apache DataFusion Ballista Distributed Query Engine
C++ Parallel Computing and Asynchronous Networking Framework
🚀 gnet is a high-performance, lightweight, non-blocking, event-driven networking framework written in pure Go.
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Ultra quick message queue and streaming server
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
Distributed Application Framework for .NET
☁️ Build multimodal AI applications with cloud-native stack
Micro second messaging that stores everything to disk
KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.
IoT Platform Framework
A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases. The VerneMQ mission is active & the project maintained. Thank you for your support!
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Python Stream Processing
Franz is a free messaging app for services like WhatsApp, Slack, Messenger and many more.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
The leader in Customer Data Infrastructure
Kroxylicious, the snappy open source proxy for Apache Kafka®
Confluent's Apache Kafka Golang client
The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.
Apache Ignite
Lightweight data stream processing engine for IoT edge