Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
85,081 visible repositories in the index
1–8 of 8 · Most stars
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.
A fast inference library for running LLMs locally on modern consumer-class GPUs
Docker configuration for running VLLM on dual DGX Sparks
Running Docling as an API service
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
An agent that compiles git maintenance chores into reusable programs, then decides whether to replay them by running checks rather than by guessing the task looks familiar