47,133 repositories indexed
1–24 of 53 · Most stars
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Incremental engine for long horizon agents 🌟 Star if you like it!
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Build, Manage and Deploy AI/ML Systems
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Generic command line non-JVM Apache Kafka producer and consumer
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
AI Infra / AI Orchestration / AI Control Plane
Concurrent and multi-stage data ingestion and data processing with Elixir
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
Distributed Big Data Orchestration Service
EventMesh is a new generation serverless event middleware for building distributed event-driven applications.
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
The swiss army knife of healthcare integration.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Healthcare data infrastructure for next generation care delivery.