Ranked by Attention Score: stars gained over the last 90 complete days
1–100 of 204 by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Cross-platform, customizable ML solutions for live and streaming media.
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Apache Kafka - A distributed event streaming platform
Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed
Apache Spark - A unified analytics engine for large-scale data processing
Incremental engine for long horizon agents 🌟 Star if you like it!
High-Performance server for NATS.io, the cloud and edge native messaging system.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
An orchestration platform for the development, production, and observation of data assets.
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
Always know what to expect from your data.
IM Chat OpenClaw
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Efficient reliable UDP unicast, UDP multicast, and IPC message transport
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
The Open Source Feature Store for AI/ML
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
Build, Manage and Deploy AI/ML Systems
Upserts, Deletes And Incremental Processing on Big Data.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
Open-Source Web UI for Apache Kafka Management
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Golang client for NATS, the cloud native messaging system.
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
TranslatedAlibaba's MySQL binlog incremental subscription & consumption component
Distributed stream processing engine in Rust
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Apache Pulsar - distributed pub-sub messaging system
Apache Beam is a unified programming model for Batch and Streaming data processing.
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
Eclipse iceoryx™ - true zero-copy inter-process-communication
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Apache DataFusion Ballista Distributed Query Engine
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
A cluster computing framework for processing large-scale geospatial data
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Ultra quick message queue and streaming server
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
Distributed Application Framework for .NET
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
Micro second messaging that stores everything to disk
IoT Platform Framework
A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases. The VerneMQ mission is active & the project maintained. Thank you for your support!
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Python Stream Processing
Franz is a free messaging app for services like WhatsApp, Slack, Messenger and many more.
AI Infra / AI Orchestration / AI Control Plane
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
The leader in Customer Data Infrastructure
Database Subsetting and Relational Data Browsing Tool.
Kroxylicious, the snappy open source proxy for Apache Kafka®
The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.
Apache Ignite
Lightweight data stream processing engine for IoT edge
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Concurrent and multi-stage data ingestion and data processing with Elixir
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
A modern high-performance open source message queuing system
🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications
Kubernetes-native platform to run massively parallel data/streaming jobs
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
EventMesh is a new generation serverless event middleware for building distributed event-driven applications.
Karapace - Your Apache Kafka® essentials in one tool
Python Streaming DataFrames for Kafka
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
For SwiftUI apps - a primitive component to make Chat-UI with stable prepending - no scroll jumps when loading older messages.
Confluent's Apache Kafka .NET client