Repository Index

A high-throughput and memory-efficient inference and serving engine for LLMs

• gpt
• llm
• pytorch
• model-serving

Fast and memory-efficient exact attention

Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2

• pytorch
• protein-structure
• alphafold2

An asyncio-based, memory-efficient HTTP/HTTPS/SOCKS4/SOCKS5 forward proxy server for MicroPython, compatible with CPython