Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Repository Index
132,241 visible repositories in the index
25–30 of 30 · Most stars
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
🤗 Optimum Intel: Accelerate inference with Intel optimization tools
- diffusers
- openvino
- optimization
- transformers
A ~45 MB MaaS platform: one cluster across public and private clouds, on any mix of accelerators.
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
FairPlayCombined is a platform designed to accelerate app development using .NET, Blazor, and more. It includes real-world templates like video sharing and dating apps, reducing costs and time-to-market. Perfect for developers, startups, and businesses, it empowers innovation and delivers value with pre-built tools and resources.
- aspire
- blazor
- csharp
- dotnet