Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
A set of Rack middleware and cache helpers that implement various caching strategies.
Pocache is a minimal cache package which focuses on a preemptive optimistic caching strategy
In-memory key-value server in Rust that speaks RESP, so redis-cli and Redis clients connect. Locks, rate limits, job queues and a change feed are single commands; Raft-based failover. Clients for Rust, .NET, Go, Java, Python and Node.js.
Caching implementation with a variety of storage options, as well as codified caching strategies for callbacks, classes, and output
- cache
- psr-6
- psr-16