LLMRouter: An Open-Source Library for LLM Routing
Repository Index
83,087 visible repositories in the index
697–720 of 1,536 · Most stars
Same agent Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
- observability
- llmops
- ai-observability
- openai
OpenGame: Open Agentic Coding for Games
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.
- search
- search-engine
- federated-query
- federated-search
An open-source visual programming environment for battle-testing prompts to LLMs.
- ai
- evaluation
- large-language-models
- llmops
Toolkit for creating, sharing and using natural language prompts.
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
A framework for prompt tuning using Intent-based Prompt Calibration
- prompt-engineering
- prompt-tuning
- synthetic-dataset-generation
Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.
.NET library for the OpenAI service API by Betalgo Ranul
- csharp
- dall-e
- dotnet
- openai
NeMo Retriever Library is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever Library uses specialized NVIDIA NIM microservices to find, contextualize, and extract text, tables, charts and images that you can use in downstream generative applications.
README file generator, powered by AI.
- readme-generator
- readme
- readme-md-generator
- ai
Lucebox inference engine for heterogeneous hardware & consumer GPUs
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
한국 문서를 읽고·고치고·새로 쓰는 AI 문서 도구 — HWP·HWPX·PDF·오피스·스캔(OCR)을 Markdown으로, 신구대조·서식 보존 편집·Markdown→HWPX 작성·HWP→HWPX 변환·양식 채우기·공문서 검수까지. 라이브러리·CLI·MCP | Read, diff, edit, write and convert Korean documents (HWP, HWPX, PDF, Office, scans) — library, CLI and MCP server
- cli
- document-parser
- hancom
- hwp
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- llm
- text-embeddings
- bert-embeddings
Practical bilingual AI prompt library for prompt engineering, work, learning, content, marketing, and everyday use.
- ai
- chinese-prompts
- geo
- prompt-engineering
The pretty much "official" DSPy framework for Typescript
Find the ghost tokens. Fix them. Survive compaction. Avoid context quality decay.
- claude-code
- token-optimization
- context-window
- token-usage
Convert code repos into an LLM prompt-friendly format. Mostly built by GPT-4.
A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and agents.
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.