A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
47,133 repositories indexed
25–48 of 826 · Most stars
🙌 OpenHands: AI-Driven Development
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
- ocr
- chineseocr
- pdf2markdown
- pp-ocr
Graphs that teach > graphs that impress. Turn any code into an interactive knowledge graph you can explore, search, and ask questions about. Works with Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.
- claude-code
- claude-skills
- understandcode
- codex
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Translated📚 "Building Agents from Scratch" — A Tutorial on Agent Principles and Practice, Starting from Zero
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
- agentic-coding
- ai-coding
- anthropic
- claude-code
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
TranslatedA Simple and Universal Swarm Intelligence Engine, Predicting Anything. A concise and universal swarm intelligence engine that predicts everything
- agent-memory
- financial-forecasting
- future-prediction
- knowledge-graph
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
Bash is all you need - A nano claude code–like 「agent harness」, built from 0 to 1
- agent
- claude-code
- teaching
- agent-development
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
- fine-tuning
- llama
- llms
- gemma
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- llm-inference
- ai-chat
Learn AI Engineering! Learn it. Build it. Ship it for others.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.
TranslatedProvides a practical interactive interface for LLMs (large language models) such as GPT/GLM, with special optimization for the paper reading/polishing/writing experience. Modular design, supports custom shortcut buttons & function plugins, supports project analysis & self-translation for Python, C++ and other projects, PDF/LaTeX paper translation & summarization, supports querying multiple LLM models in parallel, and supports local models such as chatglm3. Integrates Tongyi Qianwen, deepseekcoder, iFlytek Spark, ERNIE Bot, llama2, rwkv, claude2, moss, and more.
- academic
- chatglm-6b
- chatgpt
- large-language-models
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
Documented system prompts from Anthropic - Claude Fable 5.1, Opus 5.5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-6-Astra, Codex. Google - Gemini 3.8 Flash, 3.1 Pro, Antigravity. xAI - Grok, Grok Bot, Cursor, Kimi and more! Updated regularly.
The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.