Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Insane(ly slow but wicked good) PNG image optimization