Community maintained hardware plugin for vLLM on Huawei Ascend
Repository Index
138,199 visible repositories in the index
25–48 of 70 · Most stars
Same agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
- observability
- llmops
- ai-observability
- openai
An open-source visual programming environment for battle-testing prompts to LLMs.
- ai
- evaluation
- large-language-models
- llmops
Turn expensive prompts into cheap fine-tuned models
- ai
- llm
- llmops
- prompt-engineering
Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.
- architecture
- full-stack
- llmops
- llms
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
- machine-learning
- experimentation
- llm-prompting
- llm-test
🤖Self-Modifying Framework from the Future 🔮 World's First AMS
No-code multi-agent framework to build LLM Agents, workflows and applications with your data
- ai
- generative-ai
- llm-chain
- llm-framework
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
- ai-gateway
- observability
- simulation
- ai-agents
AICI: Prompts as (Wasm) Programs
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
- healthcare
- data-mining
- deep-learning
- preprocessing
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent in code using structure data and chained-calls syntax 🧩 Use Event-Driven Flow *TriggerFlow* to manage complex GenAI working logic 🔀 Switch to any model without rewrite application code
- agent
- agent-framework
- python
- framework
Llama 2 Everywhere (L2E)
- cosmopolitan
- multios
- blas
- blis
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
OpenTelemetry Instrumentation for AI Observability
A framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic interactions
- agent
- evaluation
- llmops
- simulator
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊
AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.
- agent-runtime
- agentic-rag
- ai-agent
- audit
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
- ai-agents
- ci-cd
- evals
- llm-evaluation
Evaluate your LLM's response with Prometheus and GPT4 💯
- evaluation
- litellm
- llm
- llmops
Dynamiq is an orchestration framework for agentic AI and LLM applications
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.