Sign in

Repository Index

132,241 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters

Filters

Clear all filters

49–72 of 748 · Most stars

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Translated✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field (冰霜之地, "Land of Frost"): notes on source code analysis, system design, and engineering practice

  • ios
  • objective-c
  • swift
  • javascript

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.

  • cloud
  • portable
  • bare-metal
  • hosting

The repository provides code for running inference and finetuning with the Meta Segment Anything Model 3 (SAM 3), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

vCluster creates tenant clusters: fully isolated environments delivered as managed Kubernetes, or as the foundation for Slurm, Ray, Run:ai and inference clusters. Each gets its own API server, CRDs and RBAC, and runs on an existing cluster or standalone on bare metal. CNCF Certified Kubernetes.

  • kubernetes
  • vcluster
  • virtual-clusters
  • multi-tenancy

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

  • distributed-file-system

SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling

Bayesian Modeling and Probabilistic Programming in Python

  • python
  • statistical-analysis
  • bayesian-inference
  • mcmc