AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
- k8s
- llm
- openai-api
- autoscaler
142,273 visible repositories in the index
1,585–1,608 of 3,909 · Most stars
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
E2M converts various file types (doc, docx, epub, html, htm, url, pdf, ppt, pptx, mp3, m4a) into Markdown. It’s easy to install, with dedicated parsers and converters, supporting custom configs. E2M offers an all-in-one, flexible, and open-source solution.
[ICML'26 & COLM'26] Agent0 Series: Self-Evolving Agents from Zero Data
An intelligent assistant serving the entire software development lifecycle, powered by a Multi-Agent Framework, working with DevOps Toolkits, Code&Doc Repo RAG, etc.
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
Extract structured data from documents quickly and accurately.
Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.
Understanding R1-Zero-Like Training: A Critical Perspective
This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.
AI辅助长篇小说创作,卡片式创作,支持基于 JSON Schema的结构化 AI 生成与上下文引用,可扩展性强。
The repository host gives no description.
TrustRAG:The RAG Framework within Reliable input,Trusted output
Complete logs of the experiments in the blog post 'LLMs can understand and write neural network weights'
This repository allows reproduction of Poetiq's record-breaking submission to the ARC-AGI-1 and ARC-AGI-2 benchmarks.
HOTA (and other) evaluation metrics for Multi-Object Tracking (MOT).
Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preference
[ICLR 2026] Youtu-GraphRAG: Vertically Unified Agents for Graph Retrieval-Augmented Complex Reasoning
📄 PDF extraction and rendering across all JavaScript runtimes
Chat app for Android that supports answers from multiple LLMs at once. Bring your own API key AI client. Supports OpenAI, Anthropic, Google, and Ollama. Designed with Material3 & Compose.
The Laravel AI SDK provides a unified, expressive API for interacting with AI providers such as OpenAI, Anthropic, Gemini, and more.
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.
A Web Interface for chatting with your local LLMs via the ollama API
OpenTSLM: Time-Series Language Models for Reasoning over Multivariate Medical Text- and Time-Series Data