Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Repository Index
47,133 repositories indexed
1–11 of 11 · Most stars
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- artificial-intelligence
- attention-mechanism
- transformers
- computer-vision
TranslatedQiu Xipeng's "Neural Networks and Deep Learning" (神经网络与深度学习), Second Edition and General Edition: e-book, chapter table of contents, learning resources, and errata.
- attention-mechanism
- chinese
- deep-learning
- machine-learning
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
A collection of important graph embedding, classification and representation learning papers with implementations.
- graph2vec
- classification-algorithm
- graph-kernels
- weisfeiler-lehman
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
TensorFlow Implementation of "Show, Attend and Tell"
- tensorflow
- image-captioning
- show-attend-and-tell
- attention-mechanism
Code for PaperRobot: Incremental Draft Generation of Scientific Ideas
- pytorch
- memory-networks
- generation
- end-to-end-learning
Hierarchical Attentive Recurrent Tracking
- neural-nets
- object-tracking
- attention-mechanism
- rnn
TensorFlow implementation of the paper "Hierarchical Attention Networks for Document Classification"
- text-classification
- sentiment-analysis
- hierarchical-attention-networks
- document-classification
A Tensorfflow implementation of Attend, Infer, Repeat
- tensorflow
- vae
- neural-networks
- attention-mechanism