A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
47,133 repositories indexed
1–24 of 24 · Most stars
TranslatedProvides a practical interactive interface for LLMs (large language models) such as GPT/GLM, with special optimization for the paper reading/polishing/writing experience. Modular design, supports custom shortcut buttons & function plugins, supports project analysis & self-translation for Python, C++ and other projects, PDF/LaTeX paper translation & summarization, supports querying multiple LLM models in parallel, and supports local models such as chatglm3. Integrates Tongyi Qianwen, deepseekcoder, iFlytek Spark, ERNIE Bot, llama2, rwkv, claude2, moss, and more.
- academic
- chatglm-6b
- chatgpt
- large-language-models
SGLang is a high-performance serving framework for large language models and multimodal models.
gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
- bert
- sentence-encoding
- deep-learning
- clip-model
An open-source, tool-augmented conversational language model from Fudan University
- chatgpt
- deep-learning
- dialogue-systems
- large-language-models
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
- xonsh
- devops
- iterm2
- data-engineering
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
AI 跨境电商运营智能体工具箱 · 把运营 SOP 拆成 7 个可复用的 AI Agent 工作流，含 Prompt、模板与真实案例
Universal SKILL.md catalog for research workflows: literature review, research design, project memory, manuscript writing, and cross-agent delegation for Claude Code, Codex, Gemini, Cursor, OpenClaw, and generic AI clients.
- academic-writing
- ai-skills
- notebooklm
- obsidian
Oracle3: open-source trading engine and MCP server for prediction markets. Finds fee-adjusted no-arbitrage violations across related event contracts and trades them live on Kalshi, Polymarket and Solana, or on paper, under pre-trade risk limits. 13 MCP tools, JSON CLI, agent skills, 600+ tests.
- algorithmic-trading
- kalshi
- polymarket
- python
🧱 Experimental library for building inference engines
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
- agent-security
- ai-agents
- audit-log
- claude-code
A lightweight Python SDK and CLI for evaluating recursive self-improvement (RSI) methods across agent benchmarks.
Our lightning-fast inference engine.
The World's Most Comprehensive, Authoritative, and Structured Open Source Data Source Knowledge Base
- mcp
- data-sources
- ai
- awesome-list
The repository host gives no description.
Long-term, cross-project memory for AI coding agents. Your own Obsidian vault as the source of truth. Daemonless and without opaque databases, your memory belongs to you.
The Harmony Python library: a research tool for psychologists to harmonise data and questionnaire items. Open source.
- data-harmonization
- data-science
- depression
- harmonisation
Local CrossRef database with 167M+ works and full-text search
- abstract
- citation
- impact-factor
- localhost