Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Repository Index
47,133 repositories indexed
1–3 of 3 · Most stars
Memoize functions - an optimization technique used to speed up consecutive function calls by caching the result of calls with identical input
An HTTP cache system, RFC compliant, compatible with @tyktechnologies, @traefik, @caddyserver, @go-chi, @bnkamalesh, @beego, @devfeel, @labstack, @gofiber, @go-goyave, @go-kratos, @gin-gonic, @roadrunner-server, @zalando, @zeromicro, @nginx and @apache
- http-cache
- traefik
- souin-instance
- traefik-plugin