NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
- agents
- guardrails
- python
- safety
Repository Index
58,632 visible repositories in the index
1–5 of 5 · Most stars
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
- gateway
- generative-ai
- llm-inference
- llms
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
- gpu-acceleration
- large-language-models
- llm
- llm-inference
🐋 Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). SwiGLU-H2, Stockfish-PVS L3 & 13ms Claude Code restore.
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
- apple-silicon
- clover
- coding-agents
- decision-models