The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Repository Index
47,133 repositories indexed
1–24 of 33 · Most stars
A no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.
SGLang is a high-performance serving framework for large language models and multimodal models.
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
- ai
- cognitive-architecture
- vector-database
- ai-agents
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Hermes WebUI: The best way to use Hermes Agent from the web or from your phone!
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Unified framework for building enterprise RAG pipelines with small, specialized models
- parsing
- retrieval-augmented-generation
- agents
- generative-ai-tools
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
TranslatedWorkBuddy international and domestic multi-account reverse proxy gateway, supporting Codex / Claude Code / DSH and standard OpenAI clients.
- api-gateway
- claude-code
- codebuddy
- codex
TranslatedTencent CodeBuddy account pool management console with a built-in OpenAI-compatible reverse proxy gateway: bulk onboarding of accounts via QR code scan, scheduled check-ins and keep-alive, key grouping and distribution, IP and model whitelists, call logs and usage statistics; supports one-click updates with signature verification.
- account-manager
- api-gateway
- codebuddy
- fastapi
Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)
- community-detection
- graph-clustering
- deepwalk
- networkx
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
Autonomous pentest legion — AI commander + worker swarm + layered fact-intent graph. 3rd Tencent Intelligent Attack-Defense online champion (634 teams · 8h unattended · 1B tokens beat 4.5B). The Nüwa Test: give AIs Create/Language/History, let a civilization grow.
This repo offers a simple interface that helps you to read&summerize research papers in pdf format. You can ask some questions after reading. This interface is developed based on openai API and using GPT-3.5-turbo model.
GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.
- abliterated
- abliterated-models
- ai-api
- ai-jailbreaks
The repository host gives no description.
TranslatedQoder international and China multi-account reverse proxy gateway, a multi-account OpenAI-compatible gateway hub for Qoder's international and China dual regions — COSY-signed inference, stable device fingerprints to avoid risk control, OAuth device authorization for client-free login, daily check-in and Pro benefits, background scheduled task scheduler, web monitoring dashboard, supporting Codex / Claude Code and standard OpenAI clients
AI Agent Identity and Access Management and Inference Firewall
- agent-identity
- ai-audit
- ai-firewall
- ai-gateway
OpenAI-compatible async gateway for muse.ai with pluggable drivers (mock / browser-CDP / http)
Runtime defense against memory poisoning in AI agents (OWASP ASI06). Drop-in for LangChain, OpenAI Agents, AutoGen, CrewAI and mem0.
ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses.