LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
142,273 visible repositories in the index
1–24 of 28 · Most stars
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
- python
- utilities
- cache
- data-structures
TranslatedAutomatically deletes WeChat cache data on Windows and Mac computers, including the large amount of files, videos, images, and other content automatically downloaded from all chats, freeing up your space.
Simple Linux Panel
Computing with Python functions.
- python
- parallel-computing
- caching
- multiprocessing
Full featured redis cache backend for Django.
Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
- python
- cache
- persistence
- key-value-store
Extensible memoizing collections and decorators
A slick ORM cache with automatic granular event-driven invalidation.
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- gpu-sharing
- kvcache
- llm
- sglang
fastapi-cache is a tool to cache fastapi response and function result, with backends support redis and memcached.
Persistent HTTP cache for python requests
No effort, no worry, maximum performance.
Asyncio cache manager for redis, memcached and memory
Redis for humans. 🌎🌍🌏
- python
- redis
- redis-client
- dict
Rate Limiting extension for Flask
A Redis cache backend for django
Simple LRU cache for asyncio
- asyncio
- lru
- lru-cache
A caching extension for Flask
Automatic caching and invalidation for Django models through the ORM.
A comprehensive, fast, pure-Python memcached client.
- python
- memcache
- memcached
Persistent, stale-free, local and cross-machine caching for Python functions.
Rate limiting using various strategies and storage backends such as redis, memcached & mongodb