Repository Index

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

• airflow
• apache
• apache-airflow
• python

Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

• orchestration
• data-orchestration
• high-availability
• infrastructure-as-code

An orchestration platform for the development, production, and observation of data assets.

• data-pipelines
• dagster
• workflow
• data-science

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

• workflow-schedule
• azkaban
• airflow
• task-scheduler

Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.

• cron
• workflow-engine
• workflow-scheduler
• workflow-orchestration

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

• workflow
• governance
• azkaban
• davinci

Pluggable foundation blocks for building distributed apps.

• azure
• c-sharp
• lock
• message-bus

A light-weight job scheduling system built on top of Resque

• scheduler
• queue
• background-jobs

Polyglot workflows without leaving the comfort of your technology stack.

• orchestration-framework
• scheduling
• workflow
• event-driven

Workflow Automation Engine

• workflow-engine
• workflow
• cross-platform
• automation

Simple but powerful DAG scheduler and dashboard

• directed-acyclic-graph
• airflow
• dashboard
• go

Job Scheduler for IOS with Concurrent run, failure/retry, persistence, repeat, delay and more

• job
• scheduler
• swift
• operation

A powerful background job processing library for Clojure

• clojure
• redis
• asynchronous
• background-processing

Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.

• go
• golang
• job-queue
• job-scheduler

Facilitates simple durable and asynchronous messaging in dotnet apps.

• async
• csharp
• dotnet
• messaging

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

• etl
• etl-framework
• etl-pipeline
• python