TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).
- llm
- llm-inference
- llm-serving
- llm-training
111,085 visible repositories in the index
1–24 of 125 · Most stars
TranslatedThis project aims to share the technical principles of large models and practical experience (large model engineering, large model application deployment).
Machine Learning Engineering Open Book
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Translated✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field (冰霜之地, "Land of Frost"): notes on source code analysis, system design, and engineering practice
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
A curated list of Web Performance Optimization.
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
TranslatedA collection of the Android SDK needed for Android development, tools used in development, Android development tutorials, Android design guidelines, free design resources, and more.
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
Everything about Web Application Firewalls (WAFs) from Security Standpoint! 🔥
JavaScript talks you have to see 👀 on functional programming, performance, frameworks, React, debugging, leveling up, and more!
TranslatedDeveloper internal skills cultivation
A list of RSS related stuff: tools, services, communities and tutorials, etc.
Implement a reasoning LLM in PyTorch from scratch, step by step
Translated:fire: This repository mainly contains introductory Spring Boot learning tutorials and some commonly used Spring Boot practical project tutorials, including various example code for using Spring Boot, as well as the source code and demos of some practical projects. The practical projects include basic web development and the online blog projects / large enterprise mall systems / front-end and back-end separation practice projects that are widely used today, freeing you from the constraints of all kinds of hello world introductory examples so you can truly master Spring Boot development.
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
😎Awesome GIS is a collection of geospatial related sources, including cartographic tools, geoanalysis tools, developer tools, data, conference & communities, news, massive open online course, some amazing map sites, and more.
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
Translated🙈 🙉 🙊 We select high-quality front-end news from China and abroad for you, giving you insight into the latest developments in the industry and supporting your journey of technical growth.
links to conference publications in graph-based deep learning
Translated好软分享 (Haoruan Fenxiang, "good software sharing")
CSS talks you have to see covering CSS Grid, flexbox, custom variables, performance, frameworks, tooling, and more! 📺
Learn to write Rust procedural macros [Rust Latam conference, Montevideo Uruguay, March 2019]
Pre-trained Deep Learning models and demos (high quality and extremely fast)