🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Repository Index
47,133 repositories indexed
1–9 of 9 · Most stars
Learn AI Engineering! Learn it. Build it. Ship it for others.
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
A PyTorch-based Speech Toolkit
Seamlessly integrate LLMs into scikit-learn.
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome