TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).
- llm
- llm-inference
- llm-serving
- llm-training
132,241 visible repositories in the index
1–24 of 80 · Most stars
TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).
Machine Learning Engineering Open Book
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Translated✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field (冰霜之地, "Land of Frost"): notes on source code analysis, system design, and engineering practice
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
TranslatedA collection of the Android SDK needed for Android development, tools used in development, Android development tutorials, Android design guidelines, free design resources, and more.
Implement a reasoning LLM in PyTorch from scratch, step by step
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
Pre-trained Deep Learning models and demos (high quality and extremely fast)
A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
A collection of scientific methods, processes, algorithms, and systems to build stories & models.
Your Cheat Sheet for AI Engineering Interview – Questions and Answers.
校招、秋招、春招、实习好项目!带你从零实现一个高性能的深度学习推理库,支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
Causal Inference for the Brave and True. A light-hearted yet rigorous approach to learning about impact estimation and causality.
Building a modern functional compiler from first principles.
An index of algorithms for learning causality with data
📚 Jupyter notebook tutorials for OpenVINO™
TranslatedCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
Mastering Applied AI, One Concept at a Time