TokenSpeed is a speed-of-light LLM inference engine.
Repository Index
89,572 visible repositories in the index
361–384 of 884 · Most stars
Find, benchmark and install in CLI 170+ FREE coding LLM models across 15+ providers in real time
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
- chatgpt
- visual-language-learning
- multi-modality
- foundation
The open-source ontology runtime for AI agents.
- open-source
- ontology
- rdf
- knowledge-graph
A 13B large language model developed by Baichuan Intelligent Technology
- artificial-intelligence
- chatgpt
- chinese
- gpt-4
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
- ai-gateway
- ai-gateways
- anthropic-api
- byok
🌲 春松客服,开源客服系统
- contact-center
- java
- customer-support
- chatbot
Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.
- claude
- claude-code
- cli-tool
- multi-account
Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and verified recursive self-improvement (RSI) for coding agents. AI for math, physics and software engineering.
- proof-assistant
- lean4
- ai-agents
- ai-for-math
Efficient few-shot learning with Sentence Transformers
- few-shot-learning
- nlp
- sentence-transformers
Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目,支持在 Mac mini/MacBook 上或通过算力棒本地运行推理,实现纯视觉驱动的跨平台 GUI 自动化操作。数据完全本地处理,支持复杂多步骤任务规划与执行。
- computer-use-agents
- desktop-automation
- edge-computing
- gui-automation
An Open-source Toolkit for LLM Development
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台,我们欢迎开源爱好者发起任何有意义的pr!
OpenAI Privacy Filter
Model API for GALACTICA
vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
All-in-one platform for search, recommendations, RAG, and analytics offered via API
- actix-web
- diesel
- postgresql
- qdrant
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
- apple-silicon
- local-ai
- mlx
- mtp
全能翻译 AGENT Harness · 音频 视频 游戏 电子书 · PDF EPUB RPG ASMR GALGAME · 一键 · 高质量 · 全格式
Claw 们终将接管世界,PUAClaw is All You Need
Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
- fine-tuning-llm
- large-language-models
- long-context
- llm
This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface
A meeting note-taker that talks back.
IoT Platform Framework
- golang
- iot-platform
- edge-computing
- distributed-systems