Repository Index

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

• python
• workflow
• data-engineering
• data-science

Always know what to expect from your data.

• pipeline-tests
• dataquality
• datacleaning
• datacleaner

The Open Source Feature Store for AI/ML

• machine-learning
• features
• ml
• big-data

Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk

• clickhouse
• data-engineering
• data-generation
• devops

Reverse ETL for the code-first data stack

• bigquery
• cli
• data-engineering
• dbt

Declarative data quality engine. Define checks in YAML, run anywhere.

• airflow
• anomaly-detection
• data-contracts
• data-quality

A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.

• anomaly-detection
• bigquery
• cli
• data-engineering

Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.

• csv
• data-engineering
• data-quality
• diff

Open, audit-grade agentic data quality framework with portable industry packs

• agentic-ai
• airflow
• data-engineering
• data-quality