Infrastructure for continually self‑improving agents
Repository Index
47,133 repositories indexed
1–11 of 11 · Most stars
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
Remory: Learning Residual Memory for Context Compaction
🧱 Experimental library for building inference engines
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Feel how fast a local LLM runs before you buy the hardware
llama.cpp fork that abliterates at inference