Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.
Repository Index
111,085 visible repositories in the index
817–840 of 2,458 · Most stars
HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
- evaluation
- machine-learning
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
- agent
- anthropic-api
- apple-silicon
- claude-code
Leaked GPTs Prompts Bypass the 25 message limit or to try out GPTs without a Plus subscription.
- ai
- awesome
- awesome-list
- gpts
A curated, battle-tested AI-coding toolkit: Claude Code plugins, subagent orchestration, quality gates, and ready-to-copy prompts, extracted from real production use.
Machine learning metrics for distributed, scalable PyTorch applications.
- python
- data-science
- machine-learning
- pytorch
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption
Native iOS and Android client for Open WebUI, direct OpenAI-compatible, Ollama, and Hermes agents.
- ollama
- openwebui
- selfhosted
- ai-agents
An open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experiments, inspect evidence, and compare outcomes. Turn task evidence into actionable team and organization insights.
- agent-plugin
- claude-code
- codex
- cursor
Implementation of my RAG system that won all categories in Enterprise RAG Challenge 2
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
A simple, performant, and scalable Jax LLM!
TranslatedLocal AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients through one base URL, with unified OpenAI / Anthropic / Images APIs, multi-account routing, check-in, balance and request reports
- autoclaw
- catpaw
- local-proxy
- openai-compatible
Laravel’s #1 real-time chat package. Direct messages, groups, voice notes, and much more, with a full messenger UI — plus a headless API. Install in one command.
- laravel
- laravel-package
- chat
- php
Immersive AI-driven Galgame chat with emotional expressions, desktop pet, scheduling, and interactive story modules. / 一款沉浸式 AI-Galgame 聊天软件,附带桌宠,日程,剧情功能
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram
Reproduce R1 Zero on Logic Puzzle
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
A Tool to Visualize Claude Code's LLM Interactions
This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
the terminal client for LLMs