Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Repository Index
47,133 repositories indexed
1–14 of 14 · Most stars
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
- weak-supervision
- data-cleaning
- data-quality
- noisy-labels
Minimal and clean examples of machine learning algorithms implementations
- machine-learning
- deep-learning
- neural-networks
- machine-learning-algorithms
High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)
- wandb
- reinforcement-learning
- pytorch
- python
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
Clean PyTorch implementations of imitation and reward learning algorithms
- reward-learning
- inverse-reinforcement-learning
- imitation-learning
- gymnasium
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
- python
- text-processing
- text-parser
- python-module
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
- pipeline
- pipeline-framework
- machine-learning
- deep-learning
✅2-in-1 AI Developer and Project Manager. AI agents plan an entire project in Todoist and code it task by task.
🐾 Purrge — macOS AI 磁盘清理工具，支持 Claude Code 和 Codex：空间不足时提醒，AI 逐项判断能清什么，你勾选确认后才清理
- ai
- claude-code
- disk-cleanup
- macos
HistoClean is a tool for the preprocessing and augmentation of images used in deep learning models. This easy to use application brings together the most popular image processing packages from across the python universe, meaning no more looking at documentation! HistoClean provides real time feedback to augmentations and preprocessing options. This allows users to evaluate their steps before implementation.
- image-processing
- images
- image-analysis
- deep-learning
Transform Git history: rewrite, clean, and optimize your repositories with ease.
- automation
- cli
- git
- python