Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
- metadata
- datadiscovery
- dataquality
- data-profiling
Incremental engine for long horizon agents 🌟 Star if you like it!
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
- kedro
- hacktoberfest
- mlops
- python
Build, Manage and Deploy AI/ML Systems
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
AI Infra / AI Orchestration / AI Control Plane
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
Polyglot workflows without leaving the comfort of your technology stack.
Data API Framework for AI Agents and Data Apps
An implementation of Actor, Publish-Subscribe, and CSP models in one rather small C++ framework. With performance, quality, and stability proved by years in the production.
- cpp
- cplusplus
- cplusplus-17
- actor-model
LittleHorse Server: Business-as-Code Platform for Microservices, Workflows, and Agents
Sento - Actor framework featuring actors and agents for easy access to state and asynchronous operations.
Real-time decision features without streaming infra. Turn live events into product reflexes — no Kafka, no Flink, no feature store.
Kommunicate Android AI Agent SDK
Magento 2 RabbitMQ message queue retry module
Quick integration toolkit for Ixian. Connects apps, IoT devices, AI Agents, and services to the Ixian Platform via REST APIs and message queues (MQTT/RabbitMQ). Provides developers with a simple bridge into secure Ixian communication and Client Discovery.
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.