47,133 repositories indexed
25–32 of 32 · Most stars
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
TranslatedAn AI avatar for real-time voice/text conversations with idols from "The iDOLM@STER Shiny Colors": original Japanese voice + Chinese subtitles, recalling the original story, memory shared across characters; supports Google/GitHub login and bring-your-own key, one-command deployment with Docker Compose (inspired by LAPLACE Eidolon)
:sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.
Fast fork of llama.cpp designed for Qwen3.8-Flash-Next
DeepWrite AI is Made with the Help of ChatGPT3 and Specific Model is Prepared for Generating Perfect Blog Post with atmost Clarity. This is Just the Version 1.0 More Improvement Will be Implemented.
Translated🗺️ Research Data Map — AI-driven global research visualization platform | Research Data Map with 250M+ papers