Learn LLM internals step by step - from tokenization to attention to inference optimization.
- attention-is-all-you-need
- attention-mechanism
- large-language-models
- learn-llm
98,836 visible repositories in the index
49–72 of 77 · Most stars
Learn LLM internals step by step - from tokenization to attention to inference optimization.
Notebooks covering mathematical analysis of ZKP building blocks, algorithm implementations of various proof systems, and protocol optimization techniques.
Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation
Lisp in 99 lines of C and how to write one yourself. Includes 21 Lisp primitives, garbage collection and REPL. Includes tail-call optimized versions for speed and reduced memory use.
Android 程序员需要掌握的技术栈:数据结构算法、程序架构、设计模式、性能优化、Kotlin、NDK、Jetpack,以及常用的开源框架源码分析如 Flutter、Router、RxJava、Glide、LeakCanary、Dagger2、Retrofit、OkHttp、ButterKnife 等
A curated list of awesome links and software libraries that are useful for robots.
EPFL Course - Optimization for Machine Learning - CS-439
Concise and beautiful algorithms written in Julia
Tips and tricks to optimize your C++ code
A hardware-aware guide to data structures for system software engineers.
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
船长关于机器学习、计算机视觉和工程技术的总结和分享
关于domain generalization,domain adaptation,causality,robutness,prompt,optimization,generative model各式各样研究的阅读笔记
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
QPanda 2 is an open source quantum computing framework developed by OriginQC that can be used to build, run, and optimize quantum algorithms.
Best resources for Solidity gas optimizations ⛽
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
Curated list of awesome SEO tools
Here are my template codes for Competitive Programming with optimised implementations of various algorithms. I personally use them every day and have tested almost all of them in multiple competitive programming contests and practice problems
Harness self-evolution: update targets, theory, evaluation, and reported evidence. Bilingual reading list and project website.
A curated list of awesome resources for Graal, GraalVM, Truffle and related topics
A highly optimized double-ended queue
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
A list of general purpose tricks and techniques for saving tokens in PICO-8.