Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- gpt
- large-language-models
- llm
- python
100,822 visible repositories in the index
1–8 of 8 · Most stars
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Build a modern LLM from scratch. Every line commented. Explained like we are five.
A denoising autoencoder + adversarial losses and attention mechanisms for face swapping.
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
TensorFlow Implementation of "Show, Attend and Tell"
TranslatedA tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | A small Transformer implemented from scratch with PyTorch, with an English-to-Chinese translation demo, to help understand how the model works
A database of paths that represent the mechanism of action from a drug to a disease in an indication.