Repository Index

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

• analytics
• bigquery
• data-modeling
• data-pipelines

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

• python
• pandas
• spark
• data

The repository host gives no description.

• hacktoberfest
• data
• datalineage
• dbt

Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.

• data-ops
• data-quality
• data-quality-checks
• data-quality-measurement

A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.

• anomaly-detection
• bigquery
• cli
• data-engineering

Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.

• csv
• data-engineering
• data-quality
• diff

Validates tabular CSV data using predefined validations, inspired from its Python homologue "Great Expectations".

• common-lisp
• csv
• data-validation
• great-expectations