Repository Index

Run frontier AI locally.

Graph-Native Infrastructure for Context and Accountable AI Systems

• ai
• ai-governance
• artificial-intelligence
• context-engineering

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

• pandas-profiling
• pandas-dataframe
• statistics
• jupyter-notebook

Always know what to expect from your data.

• pipeline-tests
• dataquality
• datacleaning
• datacleaner

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

• weak-supervision
• data-cleaning
• data-quality
• noisy-labels

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

• version-control
• experiment-manager
• version
• control

A light-weight, flexible, and expressive statistical data testing library

• pandas
• validation
• schema
• dataframes

Database Subsetting and Relational Data Browsing Tool.

• database
• subsetting
• frontend
• export

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

• dataprep
• data-science
• datapreparation
• dataconnector

Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.

• ai-agents
• data-integration
• golang
• graph-database

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

• spark
• pyspark
• data-wrangling
• bigdata

Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.

• data-science
• data-visualization
• visualization
• data-analysis

Library for exploring and validating machine learning data

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

• iot
• analytics
• edge
• stream-processing

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

• data-analytics
• data-cleaning
• data-cleansing
• data-engineering

Import, validate, query, and export GTFS Schedule and Realtime data with SQLite, PostgreSQL, and MySQL.

• gtfs
• node-gtfs
• transit
• transit-data

Series and Panels for Real-time and Exploratory Analysis of Data Streams

• time-series
• real-time
• data-stream
• series-manipulation

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

• csv-import
• data-import
• data-mapping
• data-review

Reactive queryable observable framework.

• reactive
• rx
• qbservable
• observable

Event-driven OneLake pipeline with automated Upsert merge and Python reporting

• activator
• data-engineering
• data-factory
• data-pipeline

Field-level assurance for data pipelines: mapping-driven source-to-target validation, fault-injection test scoring and explainable risk-adaptive test prioritization.

Bash script to export android content providers data to csv

• android
• adb
• csv
• content-provider

Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.

• nodejs
• stream-processing
• transform-as-a-service
• real-time

Experiments in Streaming