LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Extensible memoizing collections and decorators
A slick ORM cache with automatic granular event-driven invalidation.
Asyncio cache manager for redis, memcached and memory