Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
- amd
- gfx1151
- gpu-inference
- hip
132,183 visible repositories in the index
457–480 of 1,097 · Most stars
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
Application implementation with business use cases for safely utilizing generative AI in business operations
AI Image Prompts — 10,000+ curated prompts for any model. Works with Nano Banana Pro, Nano Banana 2, Seedream 5.0, GPT Image 1.5, Midjourney, DALL-E, Flux, Stable Diffusion, and more.
Zero-GPU CPU inference for 30B-284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup v2, DeepSeek-V4 284B, Nemotron-30B) + RouteCrack 2.0.
Word GPT Plus is a word add-in which integrates the AI&Agent into Microsoft Word.
把英文论文读成舒服的中文:本地 PDF 论文翻译、原文对照、边读边问 AI、文献管理。Read English papers in comfortable Chinese.
LLMs for your CLI
TranslatedA multi-account gateway that turns Tencent WorkBuddy accounts into an OpenAI-compatible API, while automatically completing all tasks in the task center. Includes a web management panel (account pool visualization / points tasks / hot configuration updates). An enhanced fork based on Sliverkiss/workbuddy2api
KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.
Medical o1, Towards medical complex reasoning with LLMs
Scalable and memory-optimized training of diffusion models
Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini
LiveBench: A Challenging, Contamination-Free LLM Benchmark
Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is the proving ground. MCP server + CLI.
OpenAI-compatible API for Gemini Business with multi-account load balancing and multimodal capabilities (image/video generation, file parsing) | 将 Gemini Business 转为 OpenAI 兼容接口,支持多账户负载均衡及多模态能力(图像生成、视频生成、解析文件)
HuatuoGPT, Towards Taming Language Models To Be a Doctor. (An Open Medical GPT)
OpenTelemetry Instrumentation for AI Observability
实时交互数字人,可自定义形象与音色,支持音色克隆,对话延迟低至3s。Real-time voice interactive digital human, customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.
Standalone CliProxyAPI usage tracker with SQLite persistence and built-in dashboard.
AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.
The repository host gives no description.
ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.
AWS-native chatbot using Bedrock
Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows