Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.
- edge-ai
- foundation-model
- on-device-ai
140,194 visible repositories in the index
1–8 of 8 · Most stars
Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.
free C++ class library of cryptographic schemes
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
An application that allows you to change the settings of MSI laptops running Linux
The repository host gives no description.
Training transferable end-to-end quadrotor control policies on a laptop in 18 seconds.
Details for building a USB keyboard and touchpad controller from an old laptop.