Repository Index

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

• nlp
• datasets
• pytorch
• tensorflow

Toolkit for linearizing PDFs for LLM datasets/training

Datasets, Transforms and Models specific to Computer Vision

• computer-vision
• machine-learning

CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.

• video-annotation
• computer-vision
• computer-vision-annotation
• image-annotation

pix2code: Generating Code from a Graphical User Interface Screenshot

• deep-learning
• datasets
• deep-neural-networks
• front-end-development

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

• weak-supervision
• data-cleaning
• data-quality
• noisy-labels

Open source annotation tool for machine learning practitioners.

• natural-language-processing
• machine-learning
• annotation-tool
• python

A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning

• machine-learning
• python
• statistics
• data-science

Fast Python Collaborative Filtering for Implicit Feedback Datasets

• collaborative-filtering
• machine-learning
• matrix-factorization
• recommender-system

Visualize and compare datasets, target values and associations, with one line of code.

• pandas-dataframe
• eda
• pandas
• data-exploration

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

• ai
• fairness-ai
• fairness
• fairness-testing

What's in your data? Extract schema, statistics and entities from datasets

• python
• privacy
• pii
• npi

RNNLG is an open source benchmark toolkit for Natural Language Generation (NLG) in spoken dialogue system application domains. It is released by Tsung-Hsien (Shawn) Wen from Cambridge Dialogue Systems Group under Apache License 2.0.

• natural-language-processing
• natural-language-generation
• nlg-dataset
• deep-learning

Code for PaperRobot: Incremental Draft Generation of Scientific Ideas

• pytorch
• memory-networks
• generation
• end-to-end-learning

AgML is a centralized framework for agricultural machine learning. AgML provides access to public agricultural datasets for common agricultural deep learning tasks, with standard benchmarks and pretrained models, as well the ability to generate synthetic data and annotations.

• deep-learning
• agriculture
• pytorch
• dataset

Using deep stacked residual bidirectional LSTM cells (RNN) with TensorFlow, we do Human Activity Recognition (HAR). Classifying the type of movement amongst 6 categories or 18 categories on 2 different datasets.

• tensorflow
• lstm
• rnn
• stacked-layers

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

• python3
• data-science
• machine-learning
• python

The World's Most Comprehensive, Authoritative, and Structured Open Source Data Source Knowledge Base

• mcp
• data-sources
• ai
• awesome-list

Python library for handling audio datasets.

• audio
• speech-recognition
• corpus-tools
• dataset-manager

Docker image gathering packers and tools for making datasets of packed executables and training machine learning models for packing detection

• docker-image
• executable-packing
• malware-packers
• research-platform