1.LMCache / LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layeramdcudainferencekv-cachellmpytorch+4 morePythonAPACHE-2.012K total2.1K forks+86 starsfrom 12,186 · score 4.47
2.ben-manes / caffeineA high performance caching library for JavaJavaAPACHE-2.018K total1.7K forks+20 starsfrom 17,913 · score 3.04
3.golang / groupcachegroupcache is a caching and cache-filling library, intended as a replacement for memcached in many cases.GoAPACHE-2.013K total1.4K forks+2 starsfrom 13,334 · score 1.10
4.allegro / bigcacheEfficient cache for gigabytes of data written in Go.cacheperformancecachinggolang-libraryhacktoberfestGoAPACHE-2.08.2K total620 forks+2 starsfrom 8,174 · score 1.10