🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 53 · Most stars
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
- deep-learning
- deep-learning-tutorial
- pytorch
- gan
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- pytorch
- resnet
- pretrained-models
- pretrained-weights
SOTA Open Source TTS
- llama
- transformer
- tts
- valle
OpenMMLab Detection Toolbox and Benchmark
- object-detection
- instance-segmentation
- fast-rcnn
- faster-rcnn
Faster Whisper transcription with CTranslate2
- deep-learning
- inference
- quantization
- speech-recognition
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- artificial-intelligence
- attention-mechanism
- transformers
- computer-vision
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
- adapter
- diffusion
- llm
- parameter-efficient-learning
Train transformer language models with reinforcement learning.
Machine Learning Engineering Open Book
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer
- codebook
- codeformer
- face-enhancement
- face-restoration
<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
- agi
- ai
- autonomous-agents
- python
pix2tex: Using a ViT to convert images of equations into LaTeX code.
Nano vLLM
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
A framework for few-shot evaluation of language models.
- evaluation-framework
- language-model
- transformer
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
- deep-learning
- pytorch
- grad-cam
- visualizations
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
HunyuanVideo: A Systematic Framework For Large Video Generation Model
- video-generation
- diffusion-models
- diffusion-transformer