Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
102,118 visible repositories in the index
1–24 of 35 · Most stars
Making large AI models cheaper, faster and more accessible
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
A General-purpose Task-parallel Programming System in C++
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
The official repo for “Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting”, ACL, 2025.
MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.
Heterogeneous GPU Sharing on Kubernetes
HIP: C++ Heterogeneous-Compute Interface for Portability
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
StellarGraph - Machine Learning on Graphs
Lucebox inference engine for heterogeneous hardware & consumer GPUs
Specification for streaming massive heterogeneous 3D geospatial datasets :earth_americas:
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
Compiler for multiple programming models (SYCL, C++ standard parallelism, HIP/CUDA) for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!
PacketFence is a fully supported, trusted, Free and Open Source network access control (NAC) solution. Boasting an impressive feature set including a captive-portal for registration and remediation, centralized wired and wireless management, powerful BYOD management options, 802.1X support, layer-2 isolation of problematic devices; PacketFence can be used to effectively secure networks small to very large heterogeneous networks.
【ICML 2025 Spotlight】 Official Repo for Paper ‘’HealthGPT : A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation‘’
Paddle Graph Learning (PGL) is an efficient and flexible graph learning framework based on PaddlePaddle
parallel graph management and execution in heterogeneous computing
TranslatedUsing dense-compute cards to accelerate sparse, large-VRAM hosts, where the hosts include AI Max+ 395, M3 512G, DGX Spark, and others.
Heterogeneous Graph Neural Network
C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows
OpenCL integration for Python, plus shiny features
pocl - Portable Computing Language