Repository Index

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

• python
• workflow
• data-engineering
• data-science

Turns Data and AI algorithms into production-ready web applications in no time.

• automation
• data-engineering
• data-ops
• data-visualization

Fancy stream processing made operationally mundane

• message-queue
• stream-processing
• streaming-data
• message-bus

Collect, aggregate, and visualize a data ecosystem's metadata

• data-lineage
• data-discovery
• data-governance
• data-provenance

Polyglot workflows without leaving the comfort of your technology stack.

• orchestration-framework
• scheduling
• workflow
• event-driven

Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.

• data-ops
• data-quality
• data-quality-checks
• data-quality-measurement