Sign in

Repository Index

132,241 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters (1)

Filters

Clear all filters

1–24 of 106 · Most stars

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

  • mnn
  • convolution
  • vulkan
  • embedded-devices

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

  • distributed-file-system

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

  • edge-ai
  • on-device-ai
  • on-device-llm

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.