Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Repository Index
47,133 repositories indexed
1–24 of 53 · Most stars
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
- ai
- cognitive-architecture
- vector-database
- ai-agents
The official Python library for the OpenAI API
- openai
- python
Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
- chinese
- large-language-models
- natural-language-processing
- flash-attention
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Supercharge Your LLM Application Evaluations 🚀
- llm
- llmops
- evaluation
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
- gpt-2
- adaptation
- language-model
- gpt-3
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
- model
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Ollama Python library
- ollama
- python
A collection of libraries to optimise AI model performances
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.
TranslatedWorkBuddy international and domestic multi-account reverse proxy gateway, supporting Codex / Claude Code / DSH and standard OpenAI clients.
- api-gateway
- claude-code
- codebuddy
- codex
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
- healthcare
- data-mining
- deep-learning
- preprocessing
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
- agents
- calibration
- classification
- decision-making