47,133 repositories indexed
1–22 of 22 · Most stars
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Fast and memory-efficient exact attention
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
Machine learning, in numpy
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
Official Tensorflow implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation (ICLR 2020)
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
TensorFlow Implementation of "Show, Attend and Tell"
Code for PaperRobot: Incremental Draft Generation of Scientific Ideas
TransformerCPI: Improving compound–protein interaction prediction by sequence-based deep learning with self-attention mechanism and label reversal experiments(BIOINFORMATICS 2020) https://doi.org/10.1093/bioinformatics/btaa524
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
Interpretable bilinear attention network with domain adaptation improves drug-target prediction.
Hierarchical Attentive Recurrent Tracking
TensorFlow implementation of the paper "Hierarchical Attention Networks for Document Classification"
A Tensorfflow implementation of Attend, Infer, Repeat
Adaptive Graph Attention Auto-encoder for Spatial Domain Identification of Spatial Transcriptomics
Deciphering cell-cell communication from spatially resolved transcriptomic data at single-cell resolution with subgraph-based attentional graph neural network