Repository Index

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

• python
• workflow
• data-engineering
• data-science

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

• asyncio
• kafka
• python
• rabbitmq

Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk

• clickhouse
• data-engineering
• data-generation
• devops

Declarative data quality engine. Define checks in YAML, run anywhere.

• airflow
• anomaly-detection
• data-contracts
• data-quality

A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.

• anomaly-detection
• bigquery
• cli
• data-engineering