AlphaFold 3 inference pipeline.
Repository Index
111,085 visible repositories in the index
97–120 of 869 · Most stars
A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
- chatgpt
- deep-learning
- instruction-following
- language-model
DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.
- causal-inference
- machine-learning
- graphical-models
- bayesian-networks
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
TranslatedA collection of the Android SDK needed for Android development, tools used in development, Android development tutorials, Android design guidelines, free design resources, and more.
- android-sdk
- android-studio
- sdk-manager
- android-development
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++
- ai
- cplusplus
- diffusion
- ggml
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
Fast, flexible LLM inference
- llm
- rust
- uqff
Responsive and slick progress bars
- progressbar
- javascript
- animation
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
- machine-learning
- scale
- workflow
- mlops
Infrastructure for continually self‑improving agents
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
Open-source implementation of AlphaEvolve
- alphacode
- coding-agent
- deepmind
- deepmind-lab
Everything about Web Application Firewalls (WAFs) from Security Standpoint! 🔥
- waf
- web-application-firewall
- firewall
- awesome-list
The repository host gives no description.
Translated💎1MB lightweight face detection model
Home of StarCoder: fine-tuning & inference!
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
- gemma
- gpgpu
- llm
- local-ai
Cutting Edge WebRTC Video Conferencing
TranslatedPaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge
JavaScript talks you have to see 👀 on functional programming, performance, frameworks, React, debugging, leveling up, and more!
- javascript
- react
- learning-resources
- awesome-list
Infection Monkey - An open-source adversary emulation platform
- penetration-testing
- security-tools
- security-automation
- infection-monkey