Repository Index

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

• amd
• cuda
• inference
• kv-cache

Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication features. Garnet can work with existing Redis clients.

• cache
• cache-storage
• cluster
• concurrent

Java large off heap cache

High-performance Swift framework for task execution, memory caching, and data management with intelligent execution merging, TTL caching, and retry logic

• async-await
• cache
• caching
• cocoapods