Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
- fine-tuning
- llama
- llms
- gemma
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
Unified framework for building enterprise RAG pipelines with small, specialized models
- parsing
- retrieval-augmented-generation
- agents
- generative-ai-tools
An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
- kv-cache
- llm-inference
- local-llm
- quantization
Official Inference Code of EAGLE-4
- eagle
- gpu
- llm-inference
- sglang
Build AI phone agents on your own computer and test every change with an AI caller. Open source, runs free with no API keys, cents per call with your own keys. Imports Dialogflow CX.
- agents-as-code
- contact-center
- conversational-ai
- cx-agent-studio
Speedrun for pretraining without backpropagation
TranslatedAn AI avatar for real-time voice/text conversations with idols from "The iDOLM@STER Shiny Colors": original Japanese voice + Chinese subtitles, recalling the original story, memory shared across characters; supports Google/GitHub login and bring-your-own key, one-command deployment with Docker Compose (inspired by LAPLACE Eidolon)
- ai-companion
- character-ai
- fastapi
- idolmaster
On-device Vision Model - a fully offline, free vision pipeline that gives text-only models (e.g. DeepSeek) image understanding and multilingual OCR through an OpenAI-compatible local API. Only tokens are needed: no API key, no subscription, no cloud cost. Recommended for native speakers of Chinese, English, Japanese and Korean.
Autonomous multi-agent framework to optimize scientific software
- acceleration
- agentic-ai
- ai-agents
- bioinformatics
Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.