🧠 Train a 64M-parameter LLM from scratch in just 2h!
Repository Index
62,771 visible repositories in the index
1–24 of 45 · Most stars
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
- adapter
- diffusion
- llm
- parameter-efficient-learning
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
A hyperparameter optimization framework
- python
- machine-learning
- parallel
- distributed
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
- attention
- pytorch
- paper
- cbam
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
- machine-learning
- experiment-track
- deep-learning
- keras
Fast and Accurate ML in 3 Lines of Code
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
- cloud-computing
- deep-learning
- gpu
- hyperparameter-tuning
👀 Train a 65M-parameter VLM from scratch in just 2h!
- artificial-intelligence
- chatgpt
- vision-language-model
Automated Machine Learning with scikit-learn
- automl
- scikit-learn
- automated-machine-learning
- hyperparameter-optimization
Distributed Asynchronous Hyperparameter Optimization in Python
- hacktoberfest
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
- localllm
📚 Parameterize, execute, and analyze notebooks
- jupyter
- notebooks
- notebook-generator
- nteract
HTTP parameter discovery suite.
- api-testing
- api-fuzzer
- api-fuzzing
- recon
An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.
- anomaly-localization
- anomaly-segmentation
- anomaly-detection
- unsupervised-learning
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
Train the smallest LM you can that fits in 16MB. Best model wins!
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
- chinese
- english
- multilingual
- realtime
Code and hyperparameters for the paper "Generative Adversarial Networks"
A ~9M parameter LLM that talks like a small fish.
Pretrained language model with 100B parameters