🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 48 · Most stars
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
- deep-learning
- deep-learning-tutorial
- pytorch
- gan
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- pytorch
- resnet
- pretrained-models
- pretrained-weights
SOTA Open Source TTS
- llama
- transformer
- tts
- valle
OpenMMLab Detection Toolbox and Benchmark
- object-detection
- instance-segmentation
- fast-rcnn
- faster-rcnn
Faster Whisper transcription with CTranslate2
- deep-learning
- inference
- quantization
- speech-recognition
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- artificial-intelligence
- attention-mechanism
- transformers
- computer-vision
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
[ECCV 2026 Best Paper Award Candidate] LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer
- codebook
- codeformer
- face-enhancement
- face-restoration
pix2tex: Using a ViT to convert images of equations into LaTeX code.
Nano vLLM
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
[CVPR 2025 Best Paper Award] VGGT: Visual Geometry Grounded Transformer
Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
- deep-learning
- pytorch
- grad-cam
- visualizations
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
HunyuanVideo: A Systematic Framework For Large Video Generation Model
- video-generation
- diffusion-models
- diffusion-transformer
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
- transformer
- conformer
- speech-translation
- streaming-asr
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
- segmentation
- image-processing
- pspnet
- unet
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
- object-detection
- open-world
- open-world-detection
- vision-language
Hackable and optimized Transformers building blocks, supporting a composable construction.