🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nlp
- natural-language-processing
- pytorch
- pytorch-transformers
Repository Index
47,133 repositories indexed
1–24 of 26 · Most stars
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
- deep-learning
- deep-learning-tutorial
- pytorch
- gan
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- artificial-intelligence
- attention-mechanism
- transformers
- computer-vision
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
- deep-learning
- pytorch
- grad-cam
- visualizations
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
- segmentation
- image-processing
- pspnet
- unet
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation
Superduper: End-to-end framework for building custom AI applications and agents.
- ai
- mlops
- torch
- transformers
Seamlessly integrate LLMs into scikit-learn.
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
Transpile trained scikit-learn estimators and transformers to C, C#, Go, Java, JavaScript, PHP and Ruby.
This Word Does Not Exist
DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome
- kmer
- dnabert-model
- kmer-format
- gpu
CellViT: Vision Transformers for Precise Cell Segmentation and Classification
- ai
- cell
- digitalpathology
- microscopy
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
[ECCV 2026] Official implementation of "HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models"
- diffusion-transformers
- eccv2026
- image-generation
- training-free
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
- diffusion-models
- efficient-inference
- high-resolution
- image-generation
Python package implementing ML feature engineering and pre-processing for polars or pandas dataframes.
- feature-engineering
- transformers
- pre-processing
- data-science
Universal 1d/2d data containers with Transformers functionality for data analysis.