Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Fancy stream processing made operationally mundane
AI Infra / AI Orchestration / AI Control Plane
Sync data from one Postgres database to another
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Series and Panels for Real-time and Exploratory Analysis of Data Streams
Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.
Google Pub/Sub client for Elixir
- pubsub
- google-cloud-pubsub
- google-cloud-platform
- gcp
A micro workers class that easily manages a pool of threads to optimise simultaneous jobs and jobs endings, for MicroPython (used on Pycom modules & ESP32)
Production-grade Server-Sent Events (SSE) for Fiber v3. Event coalescing, priority lanes, topic wildcards, adaptive throttling, built-in auth, Prometheus metrics, graceful drain.