Repository Index

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• gpt
• large-language-models
• llm
• python

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

TranslatedCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning

• gpu-programming
• llm
• nlp
• rl

A multi-language tokenizer for extracting identifiers from source code.