🔥🔥🔥AidLearning is a powerful AIOT development platform, AidLearning builds a linux env supporting GUI, deep learning and visual IDE on Android...Now Aid supports CPU+GPU+NPU for inference with high performance acceleration...Linux on Android or HarmonyOS
Repository Index
132,241 visible repositories in the index
121–144 of 748 · Most stars
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
- fast-data-pipeline
- image-augmentation
- data-augmentation
- image-processing
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
- course
- large-language-model
- llm
- python
General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Framework agnostic sliced/tiled inference + interactive ui + error analysis plots
- object-detection
- instance-segmentation
- computer-vision
- small-object-detection
Inference and training library for high-quality TTS models.
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- flash-attention
- paged-attention
- tensorrt-llm
- vllm
A blazing fast React alternative, compatible with IE8 and React 16.
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
Superduper: End-to-end framework for building custom AI applications and agents.
- ai
- mlops
- torch
- transformers
State of the art inference performance with modern accelerators on Kubernetes
Tacotron 2 - PyTorch implementation with faster-than-realtime inference
Cost-efficient and pluggable Infrastructure components for GenAI inference
A blazing fast inference solution for text embeddings models
Translatedcube studio is an open-source, cloud-native, one-stop machine learning / deep learning / large model AI platform. It covers the full mlops algorithm pipeline, a computing power rental platform, online notebook development, drag-and-drop task flow pipeline orchestration, multi-machine multi-GPU distributed training, hyperparameter search, inference services with VGPU virtualization, edge computing, a labeling platform with automated labeling, SFT fine-tuning / reward model / reinforcement learning training for large models such as deepseek, multi-machine large model inference with vllm/ollama/mindie, a private knowledge base, and an AI model marketplace. It supports domestic Chinese CPUs/GPUs/NPUs and the Ascend ecosystem, supports RDMA, and supports distributed frameworks such as pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano.
MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.
- deep-learning
- neural-network
- opencl
- neon
Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
- agent
- agentic-ai
- agentic-framework
- agentic-workflow
An easy to use PyTorch to TensorRT converter
- jetson-nano
- jetson-tx2
- jetson-xavier
- pytorch
ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.
- machine-learning
- economics
- causal-inference
- causality
A probabilistic programming language in TensorFlow. Deep generative models, variational inference.
- bayesian-methods
- deep-learning
- machine-learning
- data-science
A unified inference and post-training framework for accelerated video generation.
- diffusers
- diffusion-models
- video-generation
- distillation
Fast inference engine for Transformer models
- neural-machine-translation
- cpp
- mkl
- quantization
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.