1.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
+17,617 stars
from 78,461 · score 9.78
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
21 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.unslothai / unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
+16,018 stars
from 62,908 · score 9.68
3.AstrBotDevs / AstrBot
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
+14,756 stars
from 30,752 · score 9.60
4.sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
+11,714 stars
from 26,634 · score 9.37
5.Aider-AI / aider
aider is AI pair programming in your terminal
+6,136 stars
from 43,749 · score 8.72
6.hiyouga / LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
+5,453 stars
from 70,371 · score 8.60
7.fishaudio / fish-speech
SOTA Open Source TTS
+3,734 stars
from 29,798 · score 8.23
8.chatchat-space / Langchain-Chatchat
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
+1,129 stars
from 37,582 · score 7.03
9.dataelement / bisheng
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
+849 stars
from 11,251 · score 6.75
10.bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
+633 stars
from 10,046 · score 6.45
11.shibing624 / MedicalGPT
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。
+593 stars
from 5,284 · score 6.39
12.haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
+495 stars
from 24,585 · score 6.21
13.TheR1D / shell_gpt
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
+383 stars
from 11,914 · score 5.95
14.bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
+337 stars
from 12,238 · score 5.82
15.zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
+259 stars
from 7,960 · score 5.56
16.LlamaChinese / Llama-Chinese
Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用
+169 stars
from 14,591 · score 5.14
17.ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
+154 stars
from 11,638 · score 5.04
18.PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
+127 stars
from 12,857 · score 4.85
19.ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
+102 stars
from 18,820 · score 4.63
20.GaiZhenbiao / ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
+59 stars
from 15,194 · score 4.09
21.geeks-of-data / knowledge-gpt
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
+3 stars
from 289 · score 1.39