Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Repository Index
85,081 visible repositories in the index
1–19 of 19 · Most stars
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.
Use your locally running AI models to assist you in your web browsing
- chat-application
- chrome-extension
- open-source
- localllm
A fast inference library for running LLMs locally on modern consumer-class GPUs
ChatOllama is an open source agentic app for running AI agents across local and hosted models.
A frontend for running models on mobile or connecting to your preferred API providers.
Docker configuration for running VLLM on dual DGX Sparks
A colab gradio web UI for running Large Language Models
- colab
- colab-notebook
- colaboratory
- gradio
Running Docling as an API service
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.
Locally running, hands-free ChatGPT UI
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.
Generate music based on natural language prompts using LLMs running locally
This project is a plugin that supports ChatGPT running on JetBrains series IDE.
- chatgpt
- chatgpt-jetbrains
An agent that compiles git maintenance chores into reusable programs, then decides whether to replay them by running checks rather than by guessing the task looks familiar
- agent-architecture
- git-automation
- llm-agents
- program-synthesis