Repository Index

🧠 Train a 64M-parameter LLM from scratch in just 2h!

• artificial-intelligence
• large-language-model

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

• adapter
• diffusion
• llm
• parameter-efficient-learning

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

• llm
• lora
• sft
• multimodal

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

• avx2
• c99
• cpu-inference
• deep-learning

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

• localllm

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

Train the smallest LM you can that fits in 16MB. Best model wins!