1.HKUDS / DeepTutor
DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.
- ai-tutor
- deepresearch
- interactive-learning
- multi-agent-systems
- rag
- ai-agents
- +3 more
Ranked by Attention Score: stars gained over the last 7 complete days
1–100 of 165 by Attention Score · Oct 28, 2026 – Nov 3, 2026 (UTC)
DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
AirLLM 2.8T LLM inference with single 4GB GPU
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
A high-throughput and memory-efficient inference and serving engine for LLMs
RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
1M param OCR model - runs on CPU, 15x faster than tesseract, close to 1B+ param models in accuracy
Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.
🧠 Train a 64M-parameter LLM from scratch in just 2h!
CaseCite is an open-source, self-hosted legal RAG caselaw research & document analysis platform.
EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.
Build AI text detectors whose decisions are mechanistically grounded and human-auditable (EMNLP 2026)
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
Next Generation Agentic Proxy for AI Agents and MCP servers
OmniEdu: Open Foundation Models for Learning and Teaching
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
A local inference engine for Apple silicon, built around the model.
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
A lightweight Python SDK and CLI for evaluating recursive self-improvement (RSI) methods across agent benchmarks.
🔥 The first-ever interactive streaming video generation benchmark.
Build AI phone agents on your own computer and test every change with an AI caller. Open source, runs free with no API keys, cents per call with your own keys. Imports Dialogflow CX.
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts
SGLang is a high-performance serving framework for large language models and multimodal models.
TranslatedBig Blue Fish desktop pet with local LLM. A Windows AI desktop pet with a built-in 4B local large model. It uses a whale-girl persona that combines weather, tech news and the current application to keep you gentle company through text bubbles. Supports one-click installation and pausing inference when off power.
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
🧱 Experimental library for building inference engines
The LLM Evaluation Framework
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
the LLM vulnerability scanner
The repository host gives no description.
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9
Open-source AI brand visibility and competitor reports. Official website: https://niubigeo.ai/ | Paid services: AI testing by real people and GEO optimization. Pricing: https://niubigeo.ai/pricing
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
Convert PDF to markdown + JSON quickly with high accuracy
Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.
Run many AI agents at once on your Mac, up to 3x faster.
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
World's first open-source enterprise world model.
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
The Developer Tool for Visual Engineers • An Open-Source AI-First Design tool • Visually build, style, and edit your code with AI • World's best, top-most agent recommended #1 Developer tool for Designers and Visual Engineers to design with Real Code.
A unified framework for building, evaluating, and recursively improving embodied agents. 🚀 Code release coming soon.
DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Sparks with TensorFold
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
The repository host gives no description.
From a universe of models to Collective Model Intelligence.
A production-grade, high-efficiency Agentic RL framework for frontier LLMs with validated recipes.
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
OCR model that handles complex tables, forms, handwriting with full layout.
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
🤖 AI Gateway | AI Native API Gateway
Train transformer language models with reinforcement learning.
A fast, helpful, and open-source document parser
A curated collection of fun and creative examples generated with Nano Banana & Nano Banana Pro🍌, Gemini-2.5-flash-image based model. We also release Nano-consistent-150K openly to support the community's development of image generation and unified models(click to website to see our blog)
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
WeVisDoc is an end-to-end document parser for page images. Fine-tuned from Qwen3-VL-2B-Instruct and Qwen3-VL-4B-Instruct, it turns a page into structured Markdown, with LaTeX formulas and HTML tables.
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
🦍 The API and AI Gateway
A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.
The Cloud-Native API Gateway and AI Gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
Oracle3: open-source trading engine and MCP server for prediction markets. Finds fee-adjusted no-arbitrage violations across related event contracts and trades them live on Kalshi, Polymarket and Solana, or on paper, under pre-trade risk limits. 13 MCP tools, JSON CLI, agent skills, 600+ tests.
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
OpenUI let's you describe UI using your imagination, then see it rendered live.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Your personal EQ coach. Build social skills and learn to handle conflict through realistic role-play and personalized feedback.
An open-source, tool-augmented conversational language model from Fudan University
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
State-of-the-Art Embeddings, Retrieval, and Reranking
TranslatedLangGPT: Empowering everyone to become a prompt expert! 🚀 📌 Proposer of Structured Prompt 📌 Initiator of Meta-Prompt 📌 The most popular paradigm for putting prompts into practice | Language of GPT The pioneering framework for structured & meta-prompt design 10,000+ ⭐ | Battle-tested by thousands of users worldwide Created by 云中江树 (Yunzhong Jiangshu, "river and trees amid the clouds")
An open-source RAG-based tool for chatting with your documents.
Go ahead and axolotl questions
Access large language models from the command-line
Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.