TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).
- llm
- llm-inference
- llm-serving
- llm-training
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
Machine Learning Engineering Open Book
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Translated✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field (冰霜之地, "Land of Frost"): notes on source code analysis, system design, and engineering practice
- ios
- objective-c
- swift
- javascript
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Your Cheat Sheet For AI Engineering Interviews at Top AI Companies - Questions and Answers.
- ai
- ai-engineering
- ai-interview
- ai-interview-questions
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
- cli
- deep-learning
- education
- from-scratch
A collection of awesome papers, articles and various resources on credit and credit risk modeling
- credit-scoring
- credit-modeling
- financial-machine-learning
- sample-selection
Translated🐋 Complete guide in Russian: how to install and run DeepSeek locally (V4, R1) on PC, Mac and server — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, agents, fine-tuning, best tips and tricks
- ai-agents
- deepseek
- deepseek-r1
- deepseek-v4
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
- tensorflow-2
- tensorflow-lite
- on-device-ml
- model-quantization