Ranked by Attention Score: stars gained over the last 180 complete days
1–100 of 470 by Attention Score · May 8, 2026 – Nov 3, 2026 (UTC)
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Incremental engine for long horizon agents 🌟 Star if you like it!
Cross-platform, customizable ML solutions for live and streaming media.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Apache Kafka - A distributed event streaming platform
Object-storage native graph database with branching and typed ontology
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Apache Spark - A unified analytics engine for large-scale data processing
High-Performance server for NATS.io, the cloud and edge native messaging system.
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.
🪓 An orchestration engine for background tasks, AI agents, and durable workflows
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
All-in-one IoT Platform - Device management, data collection, processing and visualization.
Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed
An orchestration platform for the development, production, and observation of data assets.
🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.
Open Source Feature Flags, Experimentation, and Product Analytics
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL
The polyglot queue: Fast and reliable background jobs in Go, Java, JS, Ruby, and Rust on Postgres/SQLite.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
Queueing jobs in Postgres from Node.js like a boss
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Python SQL Parser and Transpiler
KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes
A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.
IM Chat OpenClaw
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Eclipse Mosquitto - An open source MQTT broker
Always know what to expect from your data.
Agentic BI. Analytics at the speed of code ⚡️
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
Node-based Visual Programming Toolbox
Open source RabbitMQ: core server and tier 1 (built-in) plugins
Kubernetes-native platform to run massively parallel data/streaming jobs
The Open Source Feature Store for AI/ML
Efficient reliable UDP unicast, UDP multicast, and IPC message transport
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
🌊 Online machine learning in Python
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
Open-Source Web UI for Apache Kafka Management
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
Where data access meets operational intelligence
Building event-driven applications the easy way in Go.
The open source and enterprise-ready webhooks service 🦀
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
Golang client for NATS, the cloud native messaging system.
lakeFS - Data version control for your data lake | Git for data
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
TranslatedAlibaba's MySQL binlog incremental subscription & consumption component
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
Upserts, Deletes And Incremental Processing on Big Data.
ZeroMQ core engine in C++, implements ZMTP/3.1
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
Apache Pulsar - distributed pub-sub messaging system
Go DDD example application. Complete project to show how to apply DDD, Clean Architecture, and CQRS by practical refactoring.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Keep passwords and other sensitive information out of your chat logs and inboxes.
Distributed stream processing engine in Rust
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
the portable Python dataframe library
Logstash - transport and process your logs, events, or other data
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV
The open source, cloud native tool for API Mocking and Testing. Microcks is a Cloud Native Computing Foundation incubating project 🚀
An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Fancy stream processing made operationally mundane