Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
Repository Index
58,632 visible repositories in the index
361–384 of 1,117 · Most stars
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
TranslatedAI video note generation tool: let AI take notes for your videos
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
- ernie
- erniekit
- llm
- vlm
Sweep: AI coding assistant for JetBrains
- ai
- code-assistant
- developer-tools
- github-app
TranslatedSelf-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows. Yuxi = Cloud Agents + Knowledge RAG, Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.
Providing a free OpenAI GPT-4 API ! This is a replication project for the typescript version of xtekky/gpt4free
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
Open Source LLM Gateway 🦚
- openclaw
- cost-tracking
- llm-observability
- token-tracking
Jetbrains Claude Code and Codex GUI Plugin
AI Product Design Agent - Open Source
ClawX is a desktop app that provides a graphical interface for OpenClaw AI agents. It turns CLI-based AI orchestration into a desktop experience without using the terminal. China website is https://clawx.com.cn.
Adding guardrails to large language models.
Chinese version of GPT2 training code, using BERT tokenizer.
- transformer
- gpt-2
- chinese
- nlp
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
- evaluation
- benchmark
- large-language-model
- llm
A pixel office for your OpenClaw: turn invisible work states into a cozy little space with characters, daily notes, and guest agents. Code under MIT; art assets for non-commercial learning only.
- agent-collaboration
- ai-assistant
- dashboard
- flask
This repo powers my experiment where ChatGPT manages a real-money micro-cap stock portfolio.
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
- llmops
- observability
- open-telemetry
- metrics
Home of StarCoder: fine-tuning & inference!
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
- agents
- guardrails
- python
- safety
💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing tools, and more to accelerate your development.
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
GLM-5: From Vibe Coding to Agentic Engineering
- agentic-ai
- coding
- llm
- long-horizon