A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
- deepseek
- inference
- inference-engine
- llm-inference
89,572 visible repositories in the index
577–600 of 884 · Most stars
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
Cache-Augmented Generation: A Simple, Efficient Alternative to RAG
ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.
Open Academic Research on Improving LLaMA to SOTA LLM
An all-in-one LLMs Chat UI for Apple Silicon Mac using MLX Framework.
Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B
Extract and convert data from any document, images, pdfs, word doc, ppt or URL into multiple formats (Markdown, JSON, CSV, HTML) with intelligent structured data extraction and advanced OCR.
Source-available agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.
🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization's knowledge base and use it as a corporate oracle. Supports open-source LLMs like Llama 2, Falcon, and GPT4All.
KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델 (KoAlpaca: An open-source language model to understand Korean instructions)
A self-hosted sandbox for red teams to test payloads against modern detection before deployment. MCP integration lets an LLM agent drive analysis end to end.
Real-time monitoring for Claude Code agents through simple hook event tracking.
DigitalOcean Go API client
The open document intelligence platform for builders and hackers - DMS for the agentic world
Easily deployable and scalable backend server that efficiently converts various document formats (pdf, docx, pptx, html, images, etc) into Markdown. With support for both CPU and GPU processing, it is Ideal for large-scale workflows, it offers text/table extraction, OCR, and batch processing with sync/async endpoints.
Open chat interface for all your models.
Open-source platform for extracting structured data from documents using AI.
Build and iterate on your UI 10x faster with AI - right from your own IDE ☕️
Mirror your body in data. One standard, every source, one complete picture of you: a self-hosted health record built from lab reports, wearables and genetics, with every number traced to its source and a built-in MCP server. Run it with Docker and one LLM key, or keep every model local on llama.cpp.
Arkon: Enterprise AI Knowledge Hub & MCP Server. Self-hosted knowledge base for teams to manage RAG contexts, access policies, and AI skills. Connect Claude and other LLMs via Model Context Protocol (MCP) for automated, secure organizational knowledge integration.
chatglm 6b finetuning and alpaca finetuning