1.HKUDS / DeepTutor
DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.
- ai-tutor
- deepresearch
- interactive-learning
- multi-agent-systems
- rag
- ai-agents
- +3 more
Ranked by Attention Score: stars gained over the last 30 complete days
1–100 of 224 by Attention Score · Oct 5, 2026 – Nov 3, 2026 (UTC)
DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.
AirLLM 2.8T LLM inference with single 4GB GPU
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Open-source AI brand visibility and competitor reports. Official website: https://niubigeo.ai/ | Paid services: AI testing by real people and GEO optimization. Pricing: https://niubigeo.ai/pricing
A high-throughput and memory-efficient inference and serving engine for LLMs
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
🧠 Train a 64M-parameter LLM from scratch in just 2h!
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
SGLang is a high-performance serving framework for large language models and multimodal models.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
The best way to get AI coding agents to solve hard problems in complex codebases.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
A local inference engine for Apple silicon, built around the model.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts
World's first open-source enterprise world model.
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
The LLM Evaluation Framework
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Convert PDF to markdown + JSON quickly with high accuracy
Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.
The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9
the LLM vulnerability scanner
Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
OmniEdu: Open Foundation Models for Learning and Teaching
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.
Agent S: the state-of-the-art open source computer use agents
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
A production-grade, high-efficiency Agentic RL framework for frontier LLMs with validated recipes.
The Developer Tool for Visual Engineers • An Open-Source AI-First Design tool • Visually build, style, and edit your code with AI • World's best, top-most agent recommended #1 Developer tool for Designers and Visual Engineers to design with Real Code.
CaseCite is an open-source, self-hosted legal RAG caselaw research & document analysis platform.
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Your personal EQ coach. Build social skills and learn to handle conflict through realistic role-play and personalized feedback.
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Oracle3: open-source trading engine and MCP server for prediction markets. Finds fee-adjusted no-arbitrage violations across related event contracts and trades them live on Kalshi, Polymarket and Solana, or on paper, under pre-trade risk limits. 13 MCP tools, JSON CLI, agent skills, 600+ tests.
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
WeVisDoc is an end-to-end document parser for page images. Fine-tuned from Qwen3-VL-2B-Instruct and Qwen3-VL-4B-Instruct, it turns a page into structured Markdown, with LaTeX formulas and HTML tables.
FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models
Train transformer language models with reinforcement learning.
A curated collection of fun and creative examples generated with Nano Banana & Nano Banana Pro🍌, Gemini-2.5-flash-image based model. We also release Nano-consistent-150K openly to support the community's development of image generation and unified models(click to website to see our blog)
AI Skills, MCP Tools, and CLI for Unity Engine. Full AI develop and test loop. Use cli for quick setup. Efficient token usage, advanced tools. Any C# method may be turned into a tool by a single line. Works with Claude Code, Gemini, Copilot, Cursor and any other absolutely for free.
Incremental engine for long horizon agents 🌟 Star if you like it!
OpenUI let's you describe UI using your imagination, then see it rendered live.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
Official implementation of paper "Cache Engineering for Agents"
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Manages Unified Access to Generative AI Services built on Envoy Gateway
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Go ahead and axolotl questions
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
Toolkit for linearizing PDFs for LLM datasets/training
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
🦍 The API and AI Gateway
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
The open-source governance layer for AI agents: write the rules declaratively, Bernstein enforces them and produces the verifiable, replayable record. Free, Apache-2.0. https://bernstein.run
Refine high-quality datasets and visual AI models
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
Access large language models from the command-line
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
LangGPT: Empowering everyone to become a prompt expert! 🚀 📌 结构化提示词(Structured Prompt)提出者 📌 元提示词(Meta-Prompt)发起者 📌 最流行的提示词落地范式 | Language of GPT The pioneering framework for structured & meta-prompt design 10,000+ ⭐ | Battle-tested by thousands of users worldwide Created by 云中江树
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Structured Outputs
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
State-of-the-Art Embeddings, Retrieval, and Reranking
The Cloud-Native API Gateway and AI Gateway
Universal LLM Deployment Engine with ML Compilation
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
Multi-Agent Harness for Production AI
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.
An open-source RAG-based tool for chatting with your documents.
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows