Our inference and training framework to run on the Cosmos Models
Repository Index
132,241 visible repositories in the index
289–312 of 324 · Most stars
pySCENIC is a lightning-fast python implementation of the SCENIC pipeline (Single-Cell rEgulatory Network Inference and Clustering) which enables biologists to infer transcription factors, gene regulatory networks and cell types from single-cell RNA-seq data.
- single-cell
- transcriptomics
- gene-regulatory-network
- transcription-factors
High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
[NeurIPS 2025] The one-stop repository for LLM unlearning
- unlearning
- privacy-protection
- right-to-be-forgotten
- llm-unlearning
GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
- cpu
- diffusion-models
- gguf
- inference
🔥🔥 The extremely fast inference engine for decision model
- gemma
- inference-engine
- llm-inference
- llm-serving
🧱 Experimental library for building inference engines
AI Agent Identity and Access Management and Inference Firewall
- agent-identity
- ai-audit
- ai-firewall
- ai-gateway
Dyno Lab — an AI safety, alignment and interpretability research workbench for Apple Silicon. Explore activations, probes, SAEs and interventions with local inference, a Python SDK, APIs and MCP.
- ai
- ai-interpretability
- ai-safety
- aisafety
Python package facilitating the use of Bayesian Deep Learning methods with Variational Inference for PyTorch
- bayesian-inference
- deep-learning
A fast and efficient type assistant for Python, including tensor shape inference
- python
- typing
Our lightning-fast inference engine.
Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node or four-node DGX Spark fabric.
Open source compiler for your whole ML repo (support python, CUDA C/C++) into sass and cuda binary (which are closed sourced by Nvidia); 3-40% faster than Openai Triton for Neural Network (primarily LLM) based training/inferencing
- compiler
- compiler-backend
- compiler-optimization
- gpu-acceleration
Deepinfer inspired implemetation on SM80 Ampere architecture. Deepest respect for DeepSeek opensource this work!
A Long-Horizon Benchmark for Self-Improving Inference Systems
Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API
Probabilistic programming framework that facilitates objective model selection for time-varying parameter models.
- time-series-analysis
- model-selection
- bayesian-inference
- anomaly-detection
A inference framework that adapt to diverse and dynamic agent workload
- distributed-systems
- llm
- llm-agents
- system
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
- diffusion-models
- efficient-inference
- high-resolution
- image-generation
Bringing thousands of learners together to unpack DeepInfer through peer-reviewed explanations, documentation, and hands-on examples.