KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM
- ggml
- kv-cache
- llama-cpp
- llm-inference
142,273 visible repositories in the index
385–408 of 898 · Most stars
KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM
An HTTPS Proxy for Docker providing centralized configuration and caching of any registry (quay.io, DockerHub, registry.k8s.io, ghcr.io)
"Alfred for Xcode" plugin
CPU INFOrmation library (x86/x86-64/ARM/ARM64, Linux/Windows/Android/macOS/iOS)
A memcached proxy that manages data chunking and L1 / L2 caches
Eclipse Temurin™ build scripts - common across all releases/versions
Route with cache for react-router V5 like <keep-alive /> in Vue
Memoize functions - an optimization technique used to speed up consecutive function calls by caching the result of calls with identical input
shiro only provide the support of ehcache and concurrentHashMap. Here is an implement of redis cache can be used by shiro. Hope it will help you!
XCMetrics is the easiest way to collect Xcode build metrics and improve developer productivity.
Cache-based rate-limiting for Django
Java ORM alternative to MyBatis & Hibernate: JPA-style CRUD + SQL-first queries. Dynamic conditions without <if> blocks; one SQL across 25 databases (auto dialect & function adaptation); self-optimizing pagination; cache translate (no dictionary JOINs); race-proof updateFetch ledgers; sharding, multi-tenancy, data masking. In production since 2008.
Command line client for Nix binary cache hosting:
XFrame - Android快速开发框架:主要是封装有Http网络隔离框架、日志、缓存、加载等待、toast、页面状态布局管理、权限、自定义view等常用的集合框架,减少开发成本,提高软件体验!
Linux权限维持
SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics
View that imitates Ripple Effect on click which was introduced in Android L (for Android 2.3+)
✨ A magical persistence library (and so much more) for state-driven iOS and Mac apps ✨
A fast production-ready static web server with TLS (HTTPS), routing, hot reloading, caching, templating, and security in a single-binary you can set up with zero code.
Query caching for Laravel
Global settings for your Rails application.
A comic browser,support Android / iOS / MacOS / Windows / Linux. (JMComic)
Adding cache on your Laravel Eloquent queries' results is now a breeze.
Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"