Repository Index

A high-throughput and memory-efficient inference and serving engine for LLMs

• gpt
• llm
• pytorch
• model-serving

Fast and memory-efficient exact attention

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

• avx2
• c99
• cpu-inference
• deep-learning

Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2

• pytorch
• protein-structure
• alphafold2

The Hoard Memory Allocator: A Fast, Scalable, and Memory-efficient Malloc for Linux, Windows, and Mac.

• memory-allocation
• memory-manager
• malloc

A fast, simple, memory-efficient graph layout algorithm for visualizing networks in D3

• javascript
• d3js
• graph
• visualization

A very memory-efficient trie (radix tree) implementation

Split large SQL dump files into individual table files. Fast, memory-efficient, multi-dialect.

• cli
• database
• devtools
• mysql

An asyncio-based, memory-efficient HTTP/HTTPS/SOCKS4/SOCKS5 forward proxy server for MicroPython, compatible with CPython