Sign in

Repository Index

102,118 visible repositories in the index

Tags: LLM tools
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–22 of 22 · Most stars

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

TranslatedA multi-account gateway that turns Tencent WorkBuddy accounts into an OpenAI-compatible API, while automatically completing all tasks in the task center, with a web admin panel (account pool visualization / points tasks / hot config reload). An enhanced fork based on Sliverkiss/workbuddy2api

  • admin-panel
  • codebuddy
  • gateway
  • golang

TokenHub gives enterprises a private gateway to unify AI model access and governance, making every request controllable, traceable, and attributable.

  • ai
  • ai-gateway
  • enterprise
  • gateway

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

TranslatedA multi-account gateway that turns Tencent WorkBuddy accounts into an OpenAI-compatible API, while automatically completing all tasks in the task center. Includes a web management panel (account pool visualization / points tasks / hot configuration updates). An enhanced fork based on Sliverkiss/workbuddy2api

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

Google Gen AI Go SDK provides an interface for developers to integrate Google's generative models into their Go applications.

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

  • ai-gateway

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Self-hosted, multi-tenant agent harness for SRE incident diagnosis — risk-gated tool approvals, durable resumable runs, audit trail, model gateway, MCP tools, and a native desktop chat client. Written in Go.

Local LLM API Intelligent Gateway — Open-source client + Server Open Core model, unified management of multiple LLM Provider channels, providing intelligent routing, session stickiness, cost optimization, full-chain observability, and team collaborative governance.

OpenTelemetry-native tracing, token tracking, cost attribution, and prompt analytics for Go backends integrating LLMs.