LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
103,113 visible repositories in the index
1–13 of 13 · Most stars
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Computing with Python functions.
- python
- parallel-computing
- caching
- multiprocessing
Full featured redis cache backend for Django.
Extensible memoizing collections and decorators
A slick ORM cache with automatic granular event-driven invalidation.
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- gpu-sharing
- kvcache
- llm
- sglang
fastapi-cache is a tool to cache fastapi response and function result, with backends support redis and memcached.
Persistent HTTP cache for python requests
No effort, no worry, maximum performance.
Asyncio cache manager for redis, memcached and memory
Lightweight Python utilities for working with Redis
- redis
- python
- orm
- full-text-search
dogpile.cache is a Python caching API which provides a generic interface to caching backends of any variety