Unified KV Cache Compression Methods for Auto-Regressive Models
- kv-cache
- kv-cache-compression
- llm
89,572 visible repositories in the index
673–696 of 884 · Most stars
Unified KV Cache Compression Methods for Auto-Regressive Models
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
Developer friendly Natural Language Processing ✨
Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
MCP server for Apple Developer Documentation - Search iOS/macOS/SwiftUI/UIKit docs, WWDC videos, Swift/Objective-C APIs & code examples in Claude, Cursor & AI assistants
The 𝗣𝗼𝘄𝗲𝗿𝗳𝘂𝗹 Conversational AI JavaScript Library 💬 — UI for any LLM, supporting LangChain / HuggingFace / Vercel AI, and more 🧡 React, Next.js, and plain JavaScript ⭐️
[TKDE2025] Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL | A curated list of resources (surveys, papers, benchmarks, and opensource projects) on large language model-based text-to-SQL.
Lightweight library for scraping web-sites with LLMs
3D & AR SDK for Jetpack Compose (Filament, ARCore), Compose Multiplatform, SwiftUI (RealityKit, ARKit) and the web, with Flutter and React Native bridges. The maintained successor to Google Sceneform. Opens glTF/GLB and USDZ, at real size in AR. Assistant-ready: MCP server, AGENTS.md and llms.txt.
Meta Ads (Facebook/Instagram) MCP server for Claude, ChatGPT, Perplexity & Cursor — the Meta node of Pipeboard’s 5-platform family (+ Google, TikTok, Snap, Reddit). Hosted remote MCP, badged Meta Business Partner, free plan — no self-hosting required.
🔥 AI-powered web monitoring platform. Create automated scouts that search the web and send email alerts when they find what you're looking for.
Private web search for AI assistants via SearXNG — supports Claude, Cursor, and any MCP client
Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.
Turn any face into a video game character, pixel art, claymation, 3D or toy
Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini
OpenClaw alternative in your pocket
A commercially-viable ChatGpt web application built with React. 使用React搭建的一款可商业化的ChatGpt Web应用。
A free, open-source Obsidian plugin that makes your vault smarter: better search, an interactive knowledge graph, and an AI assistant that knows your notes.
LLMs as Copilots for Theorem Proving in Lean
Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is the proving ground. MCP server + CLI.
Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南
A simple standalone viewer for reading prompts from Stable Diffusion generated image outside the webui.