Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- airflow
- apache
- apache-airflow
- python
132,241 visible repositories in the index
1–24 of 38 · Most stars
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
An orchestration platform for the development, production, and observation of data assets.
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Enterprise job scheduling middleware with distributed computing ability.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
Maestro: Netflix’s Workflow Orchestrator
Docker Apache Airflow
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
🔥🔥 AllData大模型与AI数据底座,以数据平台为底座,以数据中台为桥梁,以机器学习平台为工厂,以大模型应用为上游产品,提供全链路数字化解决方案。 产品手册:https://www.yuque.com/aolingdata/product 产品演示+AI社群+商务采购:https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo
SQLite extension + bindings for Postgres NOTIFY/LISTEN semantics with durable queues, streams, pub/sub, and scheduler
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
Lightweight data stream processing engine for IoT edge
A distributed task scheduler for Dask
Database Reporting Tool and Tasks (.Net)
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
JSON output plugin for changeset extraction
Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display
Python module that allows one to easily write and run Hadoop programs.
📊 📊 📊 Monitors the health and web traffic of servers, microservices, Kubernetes/Kafka clusters, containers, and AWS services with real-time data monitoring and receive automated notifications over Slack or email.
Utilities for debouncing, throttling, rate limiting, and queueing. Non-async and Async.
Low-code tool for automating actions on real time data | Stream processing for the users.