LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Repository Index
132,241 visible repositories in the index
1–14 of 14 · Most stars
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
- ai
- ai-ocr
- gnn
- graph
TypeDB: Built for systems, not records
- database
- knowledge-base
- knowledge-representation
- reasoning
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
- artificial-intelligence
- developers
- machine-learning
- data
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- gpu-sharing
- kvcache
- llm
- sglang
OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.
- feature-engineering
- machine-learning
- featurestore
- in-memory-database
AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
- s3
- rust
- cloud-native
- ai
inferring sql queries from plain-text questions about tables
- sql
- wikisql
- deep-learning
- natural-language
A Redis module for serving tensors and executing deep learning graphs
- redisai
- pytorch
- tensorflow
- onnxruntime
Infer# is an interprocedural and scalable static code analyzer for C#. Via the capabilities of Facebook's Infer, this tool detects null dereferences, resource leaks, and thread-safety violations. It also performs taint flow tracking to detect critical security vulnerabilities like SQL injections.
LLMFlows - Simple, Explicit and Transparent LLM Apps
- ai
- llm
- llm-inference
- llmops
A library and microservice implementing the health and care terminology SNOMED CT with support for cross-maps, inference, fast full-text search, autocompletion, compositional grammar and the expression constraint language.
- terminology
- snomed-ct
- snomed
- terminology-server
Run etcd as an asynchronous inferior process