Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
- fine-tuning
- llama
- llms
- gemma
Repository Index
47,133 repositories indexed
1–24 of 46 · Most stars
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
TranslatedProvides a practical interactive interface for large language models (LLMs) such as GPT/GLM, with special optimization for the paper reading/polishing/writing experience. Modular design, supports custom shortcut buttons & function plugins, supports project analysis & self-translation for Python, C++ and other projects, PDF/LaTeX paper translation & summarization, supports querying multiple LLM models in parallel, and supports local models such as chatglm3. Integrates Tongyi Qianwen (Qwen), deepseekcoder, iFlytek Spark, ERNIE Bot (Wenxin Yiyan), llama2, rwkv, claude2, moss, and more.
- academic
- chatglm-6b
- chatgpt
- large-language-models
Get your documents ready for gen AI
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.
- context-database
- agentic-rag
- agent-memory
- self-evolving
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
- ai
- cognitive-architecture
- vector-database
- ai-agents
The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.
- text-similarity
- natural-language-processing
- word-embeddings
- python
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
- semantic-search
- information-retrieval
- ai
- python
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.
- agent-skills
- self-evolving-agents
Topic Modelling for Humans
- gensim
- topic-modeling
- information-retrieval
- machine-learning
An open-source, tool-augmented conversational language model from Fudan University
- chatgpt
- deep-learning
- dialogue-systems
- large-language-models
Retrieval and Retrieval-augmented LLMs
- embeddings
- information-retrieval
- llm
- sentence-embeddings
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
- kv-cache
- llm-inference
- local-llm
- quantization
A robust Python tool for text-based AI training and generation using GPT-2.
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
- healthcare
- data-mining
- deep-learning
- preprocessing
Build AI phone agents on your own computer and test every change with an AI caller. Open source, runs free with no API keys, cents per call with your own keys. Imports Dialogflow CX.
- agents-as-code
- contact-center
- conversational-ai
- cx-agent-studio
WeVisDoc is an end-to-end document parser for page images. Fine-tuned from Qwen3-VL-2B-Instruct and Qwen3-VL-4B-Instruct, it turns a page into structured Markdown, with LaTeX formulas and HTML tables.