LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
47,133 repositories indexed
1–7 of 7 · Most stars
Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication features. Garnet can work with existing Redis clients.
- cache
- cache-storage
- cluster
- concurrent
FusionCache is an easy to use, fast and robust hybrid cache with advanced resiliency features.
An asynchronous, persistent key-value store for .NET desktop and mobile applications, backed by SQLite. Suited to both durable data such as user settings and cached data that expires, with optional encryption and System.Text.Json serialization.
- c-sharp
- cache
- reactive-extensions
- reactive-programming
CacheManager is an open source caching abstraction layer for .NET written in C#. It supports various cache providers and implements many advanced features.
Pluggable foundation blocks for building distributed apps.
- azure
- c-sharp
- lock
- message-bus
A flexible multi-layer Go caching library to deal with in-memory and shared cache by adopting Cache-Aside pattern.