LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
86,076 visible repositories in the index
1–24 of 26 · Most stars
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
JetCache is a Java cache framework.
- java
- redis
- spring-cache
- jcache
Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.
Near-zero config .NET library that makes advanced application features like Task Scheduling, Caching, Queuing, Event Broadcasting, and more a breeze!
- dotnetcore
- background-jobs
- queue
- mailing
FusionCache is an easy to use, fast and robust hybrid cache with advanced resiliency features.
An asynchronous, persistent key-value store for .NET desktop and mobile applications, backed by SQLite. Suited to both durable data such as user settings and cached data that expires, with optional encryption and System.Text.Json serialization.
- c-sharp
- cache
- reactive-extensions
- reactive-programming
A high-performance backend cache system. It is intended for use in speeding up dynamic web applications by alleviating database load. Well implemented, it can drops the database load to almost nothing, yielding faster page load times for users, better resource utilization. It is simple yet powerful.
High performance cache framework for iOS.
Fast thread-safe inmemory cache for big number of entries in Go. Minimizes GC overhead
- golang
- go
- cache
- inmemory-cache
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- gpu-sharing
- kvcache
- llm
- sglang
Build real-time apps (Blazor included) with less than 1% of extra code responsible for real-time updates. Host 10-1000x faster APIs relying on transparent and nearly 100% consistent caching. We call it DREAM, or Distributed REActive Memoization, and it's here to turn real-time on!
- blazor
- blazor-server
- blazor-webassembly
- realtime
Twitter Image Pipeline is a robust and performant image loading and caching framework for iOS clients
- image-pipeline
- ios
- swift
- objective-c
In-memory and distributed caching toolkit for Elixir.
- cache
- distributed
- ecto
- elixir
An HTTP cache system, RFC compliant, compatible with @tyktechnologies, @traefik, @caddyserver, @go-chi, @bnkamalesh, @beego, @devfeel, @labstack, @gofiber, @go-goyave, @go-kratos, @gin-gonic, @roadrunner-server, @zalando, @zeromicro, @nginx and @apache
- http-cache
- traefik
- souin-instance
- traefik-plugin
Quick development library (AutoMapper, LinQ, IOC Dependency Injection, MemoryCache, Scheduled tasks, Json and Yml Config and Options pattern, Serializers, etc) with crossplatform support for Delphi/Firemonkey (Windows,Linux,OSX/IOS/Android) and freepascal (Windows/Linux).
- delphi
- azure
- config
- json
A collection of framework specific Cache utilities for working with Supabase.
The wise choice for Ruby memoization
- ruby
- memoization
- ruby-memoization
- benchmarks
Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs, Bitmaps.
A Caching Library is written in Swift that can cache JSON, Image, Zip or AnyObject with expiry date/TTYL and force refresh.
Caching implementation with a variety of storage options, as well as codified caching strategies for callbacks, classes, and output
- cache
- psr-6
- psr-16
Cache slam defense using a semaphore to prevent dogpile effect.
- php
- caching
High-performance Swift framework for task execution, memory caching, and data management with intelligent execution merging, TTL caching, and retry logic