Home of StarCoder2!
Repository Index
85,578 visible repositories in the index
25–48 of 53 · Most stars
Community maintained hardware plugin for vLLM on Apple Silicon
Running Docling as an API service
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
- artificial-intelligence
- documentai
- multimodal
- multimodal-deep-learning
Information hub for our project training the largest possible historical LLMs.
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Developer APIs to Accelerate LLM Projects
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
llm deploy project based mnn. This project has merged into MNN.
- chatglm-6b
- cpp
- cuda
- mnn
List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
- ai
- ai-search-engine
- artificial-intelligence
- artificial-intelligence-projects
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
- directml
- dotnet
- genai
- npu
Multimodal RL training framework for diffusion & omni models
- diffusion-models
- flow-matching
- grpo
- multimodal
AutoGroq is a groundbreaking tool that revolutionizes the way users interact with Autogen™ and other AI assistants. By dynamically generating tailored teams of AI agents based on your project requirements, AutoGroq eliminates the need for manual configuration and allows you to tackle any question, problem, or project with ease and efficiency.
- agents
- ai
- artificial-intelligence
- autogen
OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)
This project lets you create your own AI desktop companion with customizable characters and voice conversations that respond in just 1 second. Features include long-term memory, visual recognition, voice cloning and LLM training. Compatible with various Live2D customizations.
Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
- ai-gateway
- anthropic
- claude-code
- codex
This project is a plugin that supports ChatGPT running on JetBrains series IDE.
- chatgpt
- chatgpt-jetbrains
Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM): ~33 tok/s on agent tasks, ~41 in fast mode, 512K context. Plus GLM-5.3-Flash, Qwen3.8 and LFM3-Omni. MoE experts tiered across VRAM, pinned RAM and NVMe, with Xolotl Direct NVMe->VRAM. OpenAI + Anthropic API.
Web/desktop UI for Gemini CLI/Qwen Code. Manage projects, switch between tools, search across past conversations, and manage MCP servers, all from one multilingual interface, locally or remotely.
Open detection-rule standard for AI agent security threats — like Sigma, but for AI agents. Executable, testable rules for prompt injection, tool poisoning, context exfiltration and MCP attacks. Merged into open-source projects at Microsoft, Cisco, Gen Digital, MISP and FINOS. MIT-licensed.
- agent-security
- ai-security
- llm-security
- mcp-security
Runtime defense against memory poisoning in AI agents (OWASP ASI06). Drop-in for LangChain, OpenAI Agents, AutoGen, CrewAI and mem0.
Structured outputs, vectorization and tool calling for your Ash application