The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Repository Index
132,241 visible repositories in the index
1–17 of 17 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.
- knowledge-graph
- large-language-model
- logical-reasoning
- multi-hop-question-answering
🐢 Open-Source Evaluation & Testing library for LLM Agents
- mlops
- ml-validation
- ml-testing
- ai-testing
The open-source ontology runtime for AI agents.
- open-source
- ontology
- rdf
- knowledge-graph
A pipeline parallel training script for diffusion models.
TrustRAG:The RAG Framework within Reliable input,Trusted output
- rag
- retrieval-augmented-generation
- deep-research
- deep-search
A tiny library for coding with large language models.
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observability and IaC.
Tenacious tool calling built on LangGraph
[EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking
- llm
- toolkit
- watermark
- large-language-models
AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment
- speech-quality
- deep-learning
- interspeech
- icassp
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
- model-serving
- deep-learning
- machine-learning
- nerual-network
A collection of 265 rules across 26 categories that AI coding agents can use to write idiomatic, fast, and safe Rust.
NucliaDB, The AI Search database for RAG
- database
- language-model
- machine-learning
- mlops
Catch your AI agents when they lie about what they shipped — verifies claims against git instead of believing the agent.
- agent-orchestration
- cli
- developer-tools
- llm-agents