Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.
- android
- android-17
- edge-ai
- jetpack-compose
132,241 visible repositories in the index
529–552 of 748 · Most stars
Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
List of papers related to neural network quantization in recent AI conferences and journals.
An open-source computer vision framework to build and deploy apps in minutes
The most atomic way to train and inference a GPT in pure, dependency-free C
Real-time neural network inferencing
Boltzmann Machines in TensorFlow with examples
Remory: Learning Residual Memory for Context Compaction
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
A curated list of awesome work on VAEs, disentanglement, representation learning, and generative models.
Claude Code inference provider for Pi. Allows the use of Claude Code of Pro/Max subscriptions from pi.dev.
A Redis module for serving tensors and executing deep learning graphs
Inferno® is a distributed operating system. Inferno represents services and resources in a file-like name hierarchy, including devices, network and protocol interfaces, dynamic data sources, and services.Applications are written in a concurrent programming language, Limbo.
Omega-AI is a Java-based deep learning framework that helps you quickly build neural networks for inference and training. Its engine supports automatic differentiation, multithreading, and GPU acceleration with CUDA and cuDNN.
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
🐈 A collection of LLM inference providers and models
[NeurIPS 2024 Spotlight]"LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS", Zhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu, Dejia Xu, Zhangyang Wang
Fast TorToiSe inference (5x or your money back!)
The repository host gives no description.
:exclamation: uplift modeling in scikit-learn style in python :snake:
RDNA-native LLM inference engine in Rust.
inference.sh Agent skills for using our API to give your agents access to hundreds of apps and other agents
Curated research at the intersection of causal inference and natural language processing.
Llama 3+ inference in pure Java