Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
Repository Index
47,133 repositories indexed
49–72 of 180 · Most stars
🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.
- agentic-ai
- ai-agents
- ai-engineering
- ai-projects
Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!
- ai-app-builder
- bolt
- lovable
- v0
An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
TranslatedChinese LLaMA & Alpaca LLMs + local CPU/GPU training and deployment
- llm
- plm
- pre-trained-language-models
- alpaca
A book for Learning the Foundations of LLMs
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Structured Outputs
- generative-ai
- llms
- prompt-engineering
- symbolic-ai
TranslatedMainly records knowledge and interview questions related to large language model (LLMs) algorithm (application) engineers
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.
- browser
- browseros
- chromium
- linux
structured outputs for llms
- openai
- python
- pydantic-v2
- openai-functions
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
TranslatedChatGLM3 series: Open Bilingual Chat LLMs
HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- gateway
- generative-ai
- llmops
- llms
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
📋 A list of open LLMs available for commercial use.
- commercial
- large-language-models
- llm
- llms