vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
Repository Index
97,836 visible repositories in the index
73–96 of 146 · Most stars
Professional AI research tool for Zotero: chat with PDFs, whole-library search, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server. Chat with your pocket Zotero on iPhone → https://www.docsagent.app
The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.
TranslatedPagekin (formerly AI Novel Writer): free, open-source AI novel writing app for long novels and web fiction. Imitate, continue, rewrite; import writing skills. Local-first, no model bundled. Windows & macOS. Pagekin, a free AI novel writing app, covers everything from settings and blueprints to the main text, review, and final draft. It supports deconstructing and imitating, continuing, and rewriting, and can import writing Skills (such as removing the "AI flavor"). You must configure the model yourself; your works stay local.
- ai-writing
- electron
- fiction-writing
- local-first
Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
和国产大模型相关的免费工具集
- claude
- glm
- kimi-k2
- minimax
Leaked GPTs Prompts Bypass the 25 message limit or to try out GPTs without a Plus subscription.
- ai
- awesome
- awesome-list
- gpts
Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
A 100% private and local AI assistant for your desktop. Always present, able to jump into conversations. Supports unlimited MCP tools and unlimited memory with self-learning. Free WisprFlow alternative with its dictation support. Runs on macOS, Windows and Linux.
AI-native agent harness for coding workflows by python: multi-model LLM orchestration, stateful sessions, tool governance, traceable delivery, and provider routing for GPT, Claude, DeepSeek, Qwen, Kimi, GLM, and MiniMax.
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
- natural-language-processing
- prompt-tuning
- pretrained-language-model
- p-tuning
A pre-execution guard for AI coding agents. It blocks destructive Git and file system commands, plus common attempts to access sensitive files, before a tool call runs. Supports Amp Code, Antigravity CLI, Claude Code, Codex, Cursor, DeepSeek Harness, Devin CLI, GitHub Copilot CLI, Grok Build, Hermes Agent, Kimi Code, OpenClaw, OpenCode, and Pi.
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
- embeddings
- information-retrieval
- language-model
- text-classification
**ShellGPT is a free chatgpt client, now Supported online search.no need for a key, no need to log in.Multi-node automatic speed measurement switch,Long text translation with no word limit, AI graphics.免费的chatgpt客户端,已支持联网搜索,无需密钥,无需登录,多节点自动测速切换,长文翻译不限字数,AI出图**
14-stage Fusion Pipeline for LLM token compression — reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.
- ai-agent-tools
- context-compression
- context-pruning
- context-window-optimization
Unified, efficient, and easy-to-use inference infrastructure for edge AI || 面向端侧 AI 的统一、高效、易用的推理基础设施
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Chat2API enables zero-cost access to leading AI models by leveraging official web UIs. It supports providers such as DeepSeek, GLM, Kimi, MiniMax, Qwen, and Z.ai, and seamlessly integrates with tools like openlcaw, Cline, and Roo-Code.
- chatgpt-api
- deepseek-chat
- free-api
- glm-5
Optimized Agentic and LLM Bulk Processing Over Your Data
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
- healthcare
- data-mining
- deep-learning
- preprocessing
Building blocks for rapid development of GenAI applications
- rag
- document-search
- evaluation
- guardrails
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
- deepseek
- inference
- inference-engine
- llm-inference