Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
- artificial-intelligence
- deep-learning
- computer-vision
- attention-mechanism
142,187 visible repositories in the index
25–48 of 53 · Most stars
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch
Implementation of Natural Speech 2, Zero-shot Speech and Singing Synthesizer, in Pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
Implementation of TabTransformer, attention network for tabular data, in Pytorch
An All-MLP solution for Vision, from Google AI
Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
A concise but complete implementation of CLIP with various experimental improvements from recent papers
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch
Implementation of MagViT2 Tokenizer in Pytorch
A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model