47,133 repositories indexed
1–24 of 39 · Most stars
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Node-based Visual Programming Toolbox
Incremental engine for long horizon agents 🌟 Star if you like it!
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
Web Application ASP.NET 9 using Clean Architecture, DDD, CQRS, Event Sourcing and a lot of good practices
Agentic BI. Analytics at the speed of code ⚡️
📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.
Dashboard and code-driven configuration for Laravel queues.
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Sample .NET Core REST API CQRS implementation with raw SQL and DDD using Clean Architecture.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
A lightweight stream processing library for Go
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
zerocode-tdd is a community-developed, free, open-source, outcome-driven automated testing framework for Data Pipelines, ETL, REST API, Kafka(Data Streams), Databases and Load scenarios. all defined in simple JSON or YAML — with zero coding.
A full-stack DevOps on AWS framework
Messenger Clone - Real-time iOS Chat with Firebase Firestore written in Swift
Low-code tool for automating actions on real time data | Stream processing for the users.
Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.