1.LMCache / LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layeramdcudainferencekv-cachellmpytorch+4 morePythonAPACHE-2.012K total2.1K forks+343 starsfrom 11,929 · score 5.84
2.ben-manes / caffeineA high performance caching library for JavaJavaAPACHE-2.018K total1.7K forks+64 starsfrom 17,869 · score 4.17
3.allegro / bigcacheEfficient cache for gigabytes of data written in Go.cacheperformancecachinggolang-libraryhacktoberfestGoAPACHE-2.08.2K total620 forks+14 starsfrom 8,162 · score 2.71
4.dgraph-io / ristrettoA high performance memory-bound Go cachecacheperformancegolanggolibraryGoAPACHE-2.07K total463 forks+13 starsfrom 6,992 · score 2.64
5.apache / igniteApache Ignitedistributed-sql-databaseiotosginetwork-clientignitedata-management-platform+9 moreJavaAPACHE-2.05.1K total1.9K forks+10 starsfrom 5,080 · score 2.40
6.golang / groupcachegroupcache is a caching and cache-filling library, intended as a replacement for memcached in many cases.GoAPACHE-2.013K total1.4K forks+9 starsfrom 13,327 · score 2.30
7.Haneke / HanekeSwiftA lightweight generic cache for iOS written in Swift with extra love for images.SwiftAPACHE-2.05.2K total575 forks+1 starsfrom 5,149 · score 0.69