vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
Repository Index
142,273 visible repositories in the index
385–408 of 1,816 · Most stars
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
- apple-silicon
- local-ai
- mlx
- mtp
All-in-one platform for search, recommendations, RAG, and analytics offered via API
- actix-web
- diesel
- postgresql
- qdrant
Flexpilot IDE - Open-Source AI Native IDE
TranslatedUnified research workspace for humans & agents — PDF Q&A with citations, Vault, writing. A research workspace for collaboration between humans and agents; fills the human-machine context gap of the Zotero era.
- research
- academic
- knowledge-base
- literature-review
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
- deep-learning
- fine-tuning
- gpt-2
- gpt-j
Repository for benchmarking graph neural networks (JMLR 2023)
- graph-representation-learning
- graph-neural-networks
- benchmark-framework
- graph-deep-learning
A benchmark for evaluating LLMs on Chinese traditional fortune telling — Bazi (八字) and Ziwei Doushu (紫微斗数).
🎬 Evidence-led Seedance 2.5 / 2.0 prompt library: 1000+ cases traced to original posts, 490+ cross-model retest runs, 27 copy-ready templates, 80+ installable AI-video Skills. Synced daily from goodcase.ai. EN / 中文 / 日本語.
- ai-video
- awesome
- bytedance
- prompt-engineering
CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.
TranslatedLocal AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients through one base URL, with unified OpenAI / Anthropic / Images APIs, multi-account routing, check-in, balance and request reports
- autoclaw
- catpaw
- local-proxy
- openai-compatible
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
- evaluation
- evaluation-framework
- evaluation-metrics
- huggingface
OpenAPI specification for the OpenAI API
Voice AI SDK is a reusable Android library that gives any app a full voice-driven AI conversation pipeline in minutes. Voice Assistant + Android Voide AI + SDK + MVVM + Kotlin
Research into how agentic AI coding assistants work. Reconstructed prompt patterns, agent coordination, and security classification
- agentic-ai
- ai-research
- claude
- prompt-engineering
A local inference engine for Apple silicon, built around the model.
- apple-silicon
- coding-agents
- llm-inference
- macos
Antigravity Manager is a desktop application for managing the Google accounts used by Antigravity clients (including Classic, Antigravity IDE and agy CLI). View model quota in real time, switch client accounts seamlessly, and connect AI coding tools like Claude Code, Codex and OpenCode through a high-performance local API gateway.
- antigravity
- antigravity-ai
- antigravity-ide
- electron
Lora beYond Conventional methods, Other Rank adaptation Implementations for Stable diffusion.
- finetune
- stable-diffusion
提示词小助手可以一键调用智谱、硅基流动、gemini、本地ollama、百度等大语言模型服务,实现提示词翻译、润色扩写、图片反推。支持提示词预设实现一键插入、历史提示词查找等功能。是一个全能型提示词插件。The Prompt Assistant enables one-click access to LLMs/VLMs for prompt translation, expansion, and image captioning. It also supports one-click preset insertion and historical prompt search.
- comfyui
- expand
- prompt
- tags
A curated, battle-tested AI-coding toolkit: Claude Code plugins, subagent orchestration, quality gates, and ready-to-copy prompts, extracted from real production use.
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
- agent
- anthropic-api
- apple-silicon
- claude-code
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
- deep-learning
- flax
- jax
- language-model
Docker configuration for running VLLM on dual DGX Sparks
HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance