Accurate, large-scale, and extensible simulator for LLM inference Systems
Repository Index
132,241 visible repositories in the index
817–840 of 1,100 · Most stars
A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.
Rate limiting, caching, and request prioritization for modern workloads
- kubernetes
- rate-limiter
- cloud-native
- microservices
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
[Support 0.48.x](Reset Cursor AI MachineID & Auto Sign Up / In & Bypass Higher Token Limit)自动注册 Cursor Ai ,自动重置机器ID , 免费升级使用Pro功能: You've reached your trial request limit. / Too many free trial accounts used on this machine. Please upgrade to pro. We have this limit in place to prevent abuse. Please let us know if you believe this is a mistake.
- automation
- cursor
- cursor-ai
- cursor-ide
A visual, non-linear conversation workspace plugin for DeepSeek Harness ; A canvas-based session explorer and branching workspace for DeepSeek Harness.
- deepseek
- deepseek-harness
- dsh
- plugin
[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
- acceleration
- diffusion-models
- generative-ai
- generative-model
Agent Skill that transforms AI assistants into expert economics paper writers. Synthesizes 50+ guides by Cochrane, McCloskey, Shapiro, Head, Bellemare, Goldin, Kremer. Compatible with Claude Code and OpenAI Codex.
- academic-writing
- agent-skills
- ai
- claude-code
Not just GPT4! Easy to use, Self-Hosted, Unlimited and Free WEB API of the latest A.I. like Gemini, DeepSeek, Claude and GPT
- artificial-intelligence
- chatgpt
- gpt-alternative
- sirigpt
DataBuff is an AI-native APM built on Opentelemetry,with multi-agent troubleshooting out of the box.
- apm
- multi-agent
- opentelemetry
- root-cause-analysis
CLI, MCP server, and AI agent to automate YouTube workflows
django vue3 ts admin vben fastapi langchain
AI drew your research figure. Tavotto makes it publication-ready: edit matplotlib and AI-generated figures on a canvas, lay out multi-panel pages in mm, check journal rules before export. Scripts stay untouched.
- academic-publishing
- ai-tools
- claude-code
- codex
Faster than your agent alone. And better. A workflow plugin that takes a bug, idea or ticket to a verified pull request: specs, cross-model review by risk, live QA, receipts in your repo. Claude Code · Codex · Cursor · Droid · Grok Build · OpenCode · Muse Code.
- claude-code
- execution
- marketplace
- planning
🎉📱 Create dynamic modals, cards, panes for your applications in few steps. Any framework and free.
The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
- fine-tuning
- large-language-models
- optimization-algorithms
- optimizer
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
- agent-security
- ai-safety
- crewai
- evaluation
A simple CLI tool to help you remember terminal commands
Training Reasoning Models in Simulation to Natively Use Real Robots
A curated list of AI tools, agent skills, libraries, and resources for economics research, teaching, and policy analysis. Maintained by the OpenEcon team.
- ai
- awesome
- awesome-list
- causal-inference
Multi-agent AI pipeline that turns one line of text into a finished short-form drama: script, cinematic storyboards, character-consistent video. Provider-agnostic (OpenAI/Claude, MJ, Minimax, Veo/Sora, fal, ComfyUI). MIT.
High-performance Text-to-Speech server with OpenAI-compatible API, 8 voices, emotion tags, and modern web UI. Optimized for RTX GPUs.
- ai-text-to-speech
- ai-voice
- artificial-intelligence
A next-generation automatic algorithm design platform, making automated algorithm design more accessible and easier to use
- alpha-evolve
- alphacode
- openevolve
- openloop
🐋MindChat(漫谈):漫谈人生路, 笑对风霜途