1.LMCache / LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layeramdcudainferencekv-cachellmpytorch+4 morePythonAPACHE-2.012K total2.1K forks+4,169 starsfrom 8,087 · score 8.34