Run Laya, the open-source Jev-compatible System-1 decision model, from Node.js / TypeScript via ONNX Runtime
Repository Index
107,098 visible repositories in the index
169–192 of 238 · Most stars
AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
- s3
- rust
- cloud-native
- ai
OpenAlpha_Evolve is an open-source Python framework inspired by the groundbreaking research on autonomous coding agents like DeepMind's AlphaEvolve.
- alphafold
- evolutionary-algorithms
- discovery
csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.
- ai
- huggingface
- llm
- platform
Distill your LLM traces into a fast hybrid System 1 models. Open-source ML + LLM inference with calibrated deferral.
Minimal LLM inference in Rust
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
Node.js + JavaScript reference client for the Realtime API (beta)
LLM inference in C/C++
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
- android
- cpp
- edge-ai
- gguf
Low-bit LLM inference on CPU/NPU with lookup table
“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。
MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.
- llm
- lmstudio
- macbook
- mlx
A throughput-oriented high-performance serving framework for LLMs
Awesome Machine Unlearning (A Survey of Machine Unlearning)
- continual-learning
- data-deletion
- data-privacy
- data-removal
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
- cpu
- cpu-inference
- deep-learning
- faiss
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
The complete post-training stack for LLMs, plus RL for any problem. SFT, DPO and multi-turn agentic RL, with evolutionary hyperparameter optimization built in.
- reinforcement-learning
- deep-reinforcement-learning
- deep-learning
- machine-learning
List of awesome hosting sorted by minimal plan price
- nodejs
- hosting
- vps
- free
Ally-Health is an intelligent healthcare assistant that harnesses advanced AI technology and medical expertise to transform personal health management. Through natural language interaction, it helps users record symptoms, manage medications, organize medical records, and access multidisciplinary health insights—making healthcare more intelligent, p
- claude
- claude-code
- health
- health-data
maxxing the ability to run different LLMs on the smallest devices possible
[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
- alignment
- large-language-models
- preference-alignment
- rlhf
A scalable inference server for models optimized with OpenVINO™
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
- speculative-decoding