A modular RL library to fine-tune language models to human preferences
- language-modeling
- nlp
- reinforcement-learning
- dialogue-generation
108,094 visible repositories in the index
97–120 of 244 · Most stars
A modular RL library to fine-tune language models to human preferences
A local inference engine for Apple silicon, built around the model.
Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models
LLM Inference Engine for Metal, CUDA and Vulkan.
Communicate with an LLM provider using a single interface
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
ggml speech-to-text inference for 16+ model families
Inference Llama 2 in one file of pure 🔥
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
AICI: Prompts as (Wasm) Programs
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
14-stage Fusion Pipeline for LLM token compression — reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.
Large-scale LLM inference engine
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
The non profit fostering AI in India through credits, grants, resources
Unified, efficient, and easy-to-use inference infrastructure for edge AI || 面向端侧 AI 的统一、高效、易用的推理基础设施
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
Router that virtually distributes inference across connected devices in the home.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Pure C inference of Mistral Voxtral Realtime 4B speech to text model