🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Implement a reasoning LLM in PyTorch from scratch, step by step
Curated list of Agent Skills centered on people, relationships, commemorative scenes, and methodological perspectives
Awesome Knowledge Distillation
- knowledge-distillation
- knowledge-transfer
- teacher-student
- co-training
Collection of AWESOME vision-language models for vision tasks
Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.
- calibration
- causal-inference
- cold-start
- contrastive-learning
A curated list for Efficient Large Language Models
- compression
- knowledge-distillation
- language-model
- llm
A curated list of awesome papers on dataset distillation and related applications.
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
- data-augmentation
- instruction-following
- kd
- knowledge-distillation
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
Awesome List for On-Policy Distillation
rCM & Causal-rCM: Leading and Unified Algorithms/Infrastructures for Bidirectional/Autoregressive Video Diffusion Distillation at Scale
- consistency-model
- diffusion
- distillation
- jacobian-vector-product
A curated catalog of human distillliation agent skills