Alluxio, data orchestration for analytics and machine learning in the cloud
Repository Index
142,273 visible repositories in the index
1–3 of 3 · Most stars
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- gpu-sharing
- kvcache
- llm
- sglang
🤑 wrap virtually everything that can store by key to act as cache with ttl/max-age, stale-while-validate, parallel fetch protection and type-safety support
- cache
- stale-while-revalidate
- throttling
- ttl-cache