Sign in

Repository Index

107,098 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters (1)

Filters

Clear all filters

25–48 of 209 · Most stars

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

  • edge-ai
  • on-device-ai
  • on-device-llm

The Forge Cross-Platform Framework PC Windows, Steamdeck (native), Ray Tracing, macOS / iOS, Android, XBOX, PS4, PS5, Switch, Quest 2

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

TranslatedSource code for the second edition of 《剑指Offer:名企面试官精讲典型编程面试题》 (Jianzhi Offer: Famous-Company Interviewers Explain Typical Programming Interview Questions)

TranslatedSword Pointing at Offer (Coding Interviews): Typical Programming Problems Explained in Depth by Interviewers from Famous Companies

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

  • ai
  • amd-gpu
  • apple-silicon
  • asr