1.ollama / ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Ranked by Attention Score: stars gained over the last 7 complete days
6 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
A high-throughput and memory-efficient inference and serving engine for LLMs
An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.
SGLang is a high-performance serving framework for large language models and multimodal models.
🧱 Experimental library for building inference engines