Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Repository Index
47,133 repositories indexed
1–24 of 39 · Most stars
The simplest, fastest repository for training/finetuning medium-sized GPTs.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation
- knowledge-graph
- large-language-models
- retrieval-augmented-generation
- genai
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
TranslatedLangchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
- chatglm
- langchain
- llm
- knowledge-base
Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era.
- cloudflare-pages
- cloudflare-workers
- drizzle-orm
- tailwindcss
FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- gateway
- generative-ai
- llmops
- llms
A fast, helpful, and open-source document parser
- document-ocr
- document-processing
- ocr
- ocr-recognition
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
The fast, precise document-intelligence engine for every language: text, tables and metadata from 100+ formats, with OCR, transcription and code intelligence.
- text-extraction
- document-intelligence
- metadata-extraction
- pdf-extraction
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
- kv-cache
- llm-inference
- local-llm
- quantization
TranslatedTencent CodeBuddy account pool management console with a built-in OpenAI-compatible reverse proxy gateway: bulk onboarding of accounts via QR code scan, scheduled check-ins and keep-alive, key grouping and distribution, IP and model whitelists, call logs and usage statistics; supports one-click updates with signature verification.
- account-manager
- api-gateway
- codebuddy
- fastapi
Translatedvm2api: converts subscriptions into an API using a fully realistic virtual machine emulation approach
1M param OCR model - runs on CPU, 15x faster than tesseract, close to 1B+ param models in accuracy
Source-available agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.
Fullstack SaaS Boilerplate built with tRPC, Fastify and React
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.
- document-processing
- pdf-editor
- pdf-generation
Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
- word2vec
- text-mining
- natural-language-processing
- glove