Run Laya, the open-source Jev-compatible System-1 decision model, from Node.js / TypeScript via ONNX Runtime
Repository Index
132,241 visible repositories in the index
25–30 of 30 · Most stars
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
- local-ai
- ai-sdk
- decentralized-ai
- llama
Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.
- benchmarking
- deployment
- gpu
- llm-agent
Feel how fast a local LLM runs before you buy the hardware
Cycle.js version of https://swizec.com/blog/animating-svg-nodes-react-preact-inferno-vue/swizec/7311
clinfer (short for CLI inference) automatically generates CLIs from standard JS objects, classes or ES modules. Each method generates a "command", and each field an "option". The help is produced automatically.
- cli
- command-line-tool
- parser
- args