Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- airflow
- apache
- apache-airflow
- python
Repository Index
47,133 repositories indexed
1–24 of 24 · Most stars
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
- orchestration
- data-orchestration
- high-availability
- infrastructure-as-code
Turns Data and AI algorithms into production-ready web applications in no time.
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
Premium Queue package for handling distributed jobs and messages in NodeJS.
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
- workflow-schedule
- azkaban
- airflow
- task-scheduler
Lightweight job scheduling for Node.js
- cron
- scheduler
- job-scheduler
- crontab
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
Machinery is an asynchronous task queue/job queue based on distributed message passing.
- go
- golang
- task
- task-scheduler
Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.
- cron
- workflow-engine
- workflow-scheduler
- workflow-orchestration
Near-zero config .NET library that makes advanced application features like Task Scheduling, Caching, Queuing, Event Broadcasting, and more a breeze!
- dotnetcore
- background-jobs
- queue
- mailing
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
- workflow
- governance
- azkaban
- davinci
Pluggable foundation blocks for building distributed apps.
- azure
- c-sharp
- lock
- message-bus
A light-weight job scheduling system built on top of Resque
Polyglot workflows without leaving the comfort of your technology stack.
- orchestration-framework
- scheduling
- workflow
- event-driven
Workflow Automation Engine
- workflow-engine
- workflow
- cross-platform
- automation
RedisSMQ: A high-performance Redis message queue for Node.js
- redis
- background-jobs
- brokers
- dead-letter-queue
Simple but powerful DAG scheduler and dashboard
- directed-acyclic-graph
- airflow
- dashboard
- go
Job Scheduler for IOS with Concurrent run, failure/retry, persistence, repeat, delay and more
- job
- scheduler
- swift
- operation
A powerful background job processing library for Clojure
- clojure
- redis
- asynchronous
- background-processing
A simple jobs queue that just works (for Meteor.js)
- meteor
- jobs
- scheduled-tasks
- schedule
Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.
- go
- golang
- job-queue
- job-scheduler
Facilitates simple durable and asynchronous messaging in dotnet apps.
- async
- csharp
- dotnet
- messaging
🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines
- etl
- etl-framework
- etl-pipeline
- python