LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
69,259 visible repositories in the index
1–3 of 3 · Most stars
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.