1.lyogavin / airllm
AirLLM 2.8T LLM inference with single 4GB GPU
+13,308 stars
from 28,199 · score 9.50
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
36 repositories by Attention Score · Aug 5, 2026 – Nov 2, 2026 (UTC)
2.unslothai / unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
+9,810 stars
from 69,116 · score 9.19
3.ollama / ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
+9,097 stars
from 176,500 · score 9.12
4.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
+8,314 stars
from 87,764 · score 9.03
5.AstrBotDevs / AstrBot
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
+7,380 stars
from 38,128 · score 8.91
6.sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
+7,287 stars
from 31,061 · score 8.89
7.hiyouga / LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
+2,348 stars
from 73,476 · score 7.76
8.Aider-AI / aider
aider is AI pair programming in your terminal
+2,319 stars
from 47,566 · score 7.75
9.mudler / LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
+2,146 stars
from 47,969 · score 7.67
10.yamadashy / repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.
+1,685 stars
from 27,426 · score 7.43
11.fishaudio / fish-speech
SOTA Open Source TTS
+1,674 stars
from 31,858 · score 7.42
12.langchain4j / langchain4j
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
+621 stars
from 12,717 · score 6.43
13.chatchat-space / Langchain-Chatchat
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
+364 stars
from 38,347 · score 5.90
14.dataelement / bisheng
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
+329 stars
from 11,771 · score 5.80
15.bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
+240 stars
from 10,439 · score 5.48
16.shibing624 / MedicalGPT
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。
+224 stars
from 5,653 · score 5.42
17.haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
+192 stars
from 24,888 · score 5.26
18.bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
+161 stars
from 12,414 · score 5.09
19.AiHubCN / Awesome-Chinese-LLM
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
+150 stars
from 22,622 · score 5.02
20.TheR1D / shell_gpt
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
+129 stars
from 12,168 · score 4.87
21.zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
+126 stars
from 8,093 · score 4.84
22.beelzebub-labs / beelzebub
A secure low code deception runtime framework, leveraging AI for System Virtualization.
+114 stars
from 2,111 · score 4.74
23.meta-llama / llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
+92 stars
from 18,485 · score 4.53
24.LlamaChinese / Llama-Chinese
Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用
+71 stars
from 14,689 · score 4.28
25.SciSharp / LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
+71 stars
from 3,752 · score 4.28
26.ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
+69 stars
from 11,723 · score 4.25
27.PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
+63 stars
from 12,921 · score 4.16
28.ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
+40 stars
from 18,882 · score 3.71
29.tensorzero / tensorzeroArchived
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
+34 stars
from 11,676 · score 3.56
30.getumbrel / llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
+32 stars
from 10,892 · score 3.50
31.GaiZhenbiao / ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
+23 stars
from 15,230 · score 3.18
32.The-FinAI / PIXIU
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
+20 stars
from 876 · score 3.04
33.richardgill / llm-ui
The React library for LLMs
+8 stars
from 1,741 · score 2.20
34.cocktailpeanut / dalai
The simplest way to run LLaMA on your local machine
+4 stars
from 12,867 · score 1.61
35.geeks-of-data / knowledge-gpt
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
+1 stars
from 291 · score 0.69
36.SoftCreatR / php-mistral-ai-sdk
A powerful and easy-to-use PHP SDK for the Mistral AI API, allowing seamless integration of advanced AI-powered features into your PHP projects.
+1 stars
from 18 · score 0.69