Repository Index

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

• pandas-profiling
• pandas-dataframe
• statistics
• jupyter-notebook

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

• data-drift
• jupyter-notebook
• pandas-dataframe
• machine-learning

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

• machine-learning
• ml
• model-validation
• data-validation

AI Infra / AI Orchestration / AI Control Plane

• deep-learning
• machine-learning
• artificial-intelligence
• data-science

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

• data-science
• python
• dag
• data-engineering

Easy pipelines for pandas DataFrames.

• pandas
• pandas-dataframe
• pipeline
• data

Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.

Serverless ML Framework

• serverless
• machine-learning
• distributed-systems
• jupyter-notebook

Docker container for Kafka - Spark Streaming - Cassandra

A simple data project for Steam data

• steam
• steam-data
• steam-api
• python

GTFS Data Pipeline for TfNSW Bus Datasets

• gtfs
• gtfs-static
• gtfs-realtime
• tfnsw