Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?