carloslfu /slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

Stars

645 stars

Forks

54 forks

Language

Swift

License

MIT

Created

Aug 28, 2026

Last push

Nov 2, 2026

Updated

Nov 2, 2026

• apple-silicon
• llm
• llm-inference
• local-llm
• macos
• mixture-of-experts
• mlx
• ollama
• qwen
• swift
• claude-code
• inference-engine
• local-ai
• metal
• moe
• on-device-ai
• openai-api
• qwen3

Admitted to the Repository Index on Oct 28, 2026: +118 stars in 7 days.