Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
Composable Elixir library for LLM interactions built on Req and Finch
- ai
- ai-providers
- elixir
- elixir-package
Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM, Qwen and Kimi, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token.
- abliterated-models
- ai-gateway
- anthropic-compatible
- claude-api
GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.
- abliterated
- abliterated-models
- ai-api
- ai-jailbreaks
TranslatedQoder international and China multi-account reverse proxy gateway, a multi-account OpenAI-compatible gateway hub for Qoder's international and China dual regions — COSY-signed inference, stable device fingerprints to avoid risk control, OAuth device authorization for client-free login, daily check-in and Pro benefits, background scheduled task scheduler, web monitoring dashboard, supporting Codex / Claude Code and standard OpenAI clients
TranslatedFerry OpenCode's free models over to WorkBuddy — isolated runtime, concurrent detection, verdict caching, one-click import, and a local OpenAI-compatible forwarding port
TranslatedA completion of the landscape-format full character reference sheet based on the ZipZipPipe (胖次狐, "Panties Fox") AI girl character art: it is broken down into separate assets for three-view turnarounds / expressions / outfits / props, the side and back views are inferred and completed, and everything is stitched together at native pixels 1:1. CC BY-NC-SA 4.0, non-commercial.
- ai-art
- anime
- bilibili
- cc-by-nc-sa
A curated library of high-quality, professionally crafted prompts for common development tasks. Save time and improve your AI interactions with battle-tested prompt templates. You can install it as an Gemini CLI Extension.
🧱 Experimental library for building inference engines
Aixio Layer v2 recovers editable layers from flat designs where possible. 150-design benchmark vs Canva Magic Layers, Qwen-Image-Layer and GPT-6 Astra Ultra.
- ai-design
- benchmark
- image-to-layers
- layer-decomposition
A Java library to use the OpenAI Api in the simplest possible way.
An agent that compiles git maintenance chores into reusable programs, then decides whether to replay them by running checks rather than by guessing the task looks familiar
- agent-architecture
- git-automation
- llm-agents
- program-synthesis
OpenAI-compatible async gateway for muse.ai with pluggable drivers (mock / browser-CDP / http)
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Kimi, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token.
- abliterated-models
- ai-gateway
- anthropic-compatible
- claude-api
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
Go AI SDK, the Go way. One unified API across 21+ providers. Streaming, structured output, MCP support, stdlib only. Go AI SDK for AI applications inspired by Vercel AI SDK.
Free AI models for every coding tool — a local OpenAI-compatible gateway for Claude Code, Codex, Cursor, Cline and OpenCode. Based on 9router (MIT).
On-device Vision Model - a fully offline, free vision pipeline that gives text-only models (e.g. DeepSeek) image understanding and multilingual OCR through an OpenAI-compatible local API. Only tokens are needed: no API key, no subscription, no cloud cost. Recommended for native speakers of Chinese, English, Japanese and Korean.
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
The repository host gives no description.
GLM 5.3 Abliterated or Uncensored AI model — 35 jailbreak prompts, model guide and API. One 7API key also covers Claude, GPT, Gemini, Grok, DeepSeek and Kimi.
- abliterated
- abliterated-models
- anthropic-compatible
- claude-code