The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
Repository Index
132,183 visible repositories in the index
529–552 of 1,372 · Most stars
Deterministic guardrails that don't break agents
- guardrails
- guardrails-ai
- security
An enterprise AI workspace for model routing, multimodal chat, files, tools, billing, identity, and operations.
One sentence creates an AI-driven world — generate maps, characters, and watch stories emerge on their own. 一句话生成一个AI自主驱动的世界.
A Python package that makes it easy for developers to create AI apps powered by various AI providers.
This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.
Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.
- ai
- assistant-chat-bots
- computer-vision
- llm
A playground of highly experimental prompts, Jinja2 templates & scripts for machine intelligence models from OpenAI, Anthropic, DeepSeek, Meta, Mistral, Google, xAI & others. Author: Alex Bilzerian (2022-present).
- prompt
- prompt-engineering
- prompt-toolkit
- prompting
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
- deepseek
- inference
- inference-engine
- llm-inference
A ChatGPT web client that supports multiple users, multiple languages, and multiple database connections for persistent data storage. Provides Docker images and quick deployment scripts.
An open-source AI platform for knowledge work. Connect your apps, find answers, and get work done.
A series of code large language models developed by PKU-KCL
llm deploy project based mnn. This project has merged into MNN.
- chatglm-6b
- cpp
- cuda
- mnn
A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.
Millisecond decisions, any domain: a 0.8B open "System 1" model that picks between your options with calibrated probabilities. One base, swappable LoRA adapters, on your own hardware.
Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
A fork to add multimodal model training to open-r1
一行Docker命令部署的 OpenAI/GPT API代理,支持SSE流式返回、腾讯云函数 。Simple proxy for OpenAi api via a one-line docker command
ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.
Open Academic Research on Improving LLaMA to SOTA LLM
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
A Cloudflare worker script to proxy OpenAI‘s request to Azure OpenAI Service
- chatgpt
- cloudflare-workers
- azure-openai-proxy
- gpt-3
AgentEvolver: Towards Efficient Self-Evolving Agent System
- agent
- llm
- reinforcement-learning
- self-evolving
Source-available agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.