TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
The repository host gives no description.
iOS library for quickly displaying images while scrolling
Machinery is an asynchronous task queue/job queue based on distributed message passing.
- go
- golang
- task
- task-scheduler
Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
Free, open-source macOS cleaner. CleanMyMac alternative with zero telemetry. Native SwiftUI, scheduled auto-cleaning, Xcode/Homebrew/system cache cleanup. MIT licensed.
Doctrine Cache component
Fast, Declarative, Reproducible, and Composable Developer Environments using Nix
Aprende a PROGRAMAR aplicaciones ANDROID en KOTLIN sin conocimientos previos
A reactive caching and data-binding framework. Riverpod makes working with asynchronous code a breeze.
C-based/Cached/Core Computer Vision Library, A Modern Computer Vision Library
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
A high performance memory-bound Go cache
- cache
- performance
- golang
- go
HAProxy Load Balancer's development branch (mirror of git.haproxy.org)
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
open source、high performance、industrial rtsp streaming server,a lot of optimization on streaming relay,KeyFrame cache,RESTful,and web management,also EasyDarwin support distributed load balancing,a simple streaming media cloud platform architecture.
- easydarwin
- rtsp-server
- flv
- rtsp
TranslatedCombining the Spring Boot framework with other components such as JPA, MyBatis, WebSocket, Security, Shiro, cache, etc.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Fast persistent recoverable log and key-value store + cache, in C# and C++.
2bit quants, kernels and runtime for consumer devices.
Safety-first disk cleaner and space analyzer for macOS, Windows and Linux, with duplicate cleanup, app uninstall, startup management, system optimization, and maintenance.
A fast cache that automatically deletes the least recently used items
Tuist builds infrastructure for faster, more reliable build and test workflows across developers, CI, and coding agents. Shared cache, tests, and insights that sit alongside your existing CI.