Repository Index

A book series (2 published editions) on the JS language.

• book-series
• javascript
• closures
• prototypes

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

• nlp
• natural-language-processing
• pytorch
• pytorch-transformers

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• gpt
• large-language-models
• llm
• python

AI agents running research on single-GPU nanochat training automatically

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.

• yolov5
• object-detection
• pytorch
• onnx

Learn how to develop, deploy and iterate on production-grade ML applications.

• machine-learning
• deep-learning
• pytorch
• natural-language-processing

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

• deep-learning
• pytorch
• gpu
• machine-learning

Making large AI models cheaper, faster and more accessible

• deep-learning
• hpc
• large-scale
• data-parallelism

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more

• abliteration
• llm
• transformer
• censorship-resistance

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

• pytorch
• resnet
• pretrained-models
• pretrained-weights

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

• deep-learning
• machine-learning

This is the Rust course used by the Android team at Google. It provides you the material to quickly teach Rust.

• rust
• course
• classroom
• guide

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

• apple
• cua
• lume
• macos

LLM training in simple, raw C/CUDA

Find secrets with Gitleaks 🔑

• security
• security-tools
• git
• golang

This repository is maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), AI security, vulnerability research, exploit development, reverse engineering, and more. 🔥 Also check: https://hackertraining.org

• hacking
• penetration-testing
• hacking-series
• cybersecurity

Translated:star2: Wiki of OI / ICPC for everyone. (An online walkthrough for a certain large game, containing cool arithmetic magic)

• oi
• oi-handbook
• data-structures
• algorithms

TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).

• llm
• llm-inference
• llm-serving
• llm-training

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

• audio-generation
• gpt-4o
• text-to-speech
• tts

TranslatedPArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (Core framework of 'PaddlePaddle' (飞桨, Feijiang), for deep learning & machine learning: high-performance single-machine and distributed training, and cross-platform deployment)

• paddlepaddle
• deep-learning
• scalability
• machine-learning

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework