🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.
- pattern-matching
- typescript
- ts
- pattern
132,241 visible repositories in the index
49–72 of 748 · Most stars
🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
Translated✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field (冰霜之地, "Land of Frost"): notes on source code analysis, system design, and engineering practice
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
The repository provides code for running inference and finetuning with the Meta Segment Anything Model 3 (SAM 3), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
vCluster creates tenant clusters: fully isolated environments delivered as managed Kubernetes, or as the foundation for Slurm, Ray, Run:ai and inference clusters. Each gets its own API server, CRDs and RBAC, and runs on an existing cluster or standalone on bare metal. CNCF Certified Kubernetes.
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Spark-TTS Inference Code
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
Production ready toolkit to run AI locally
Official Python inference and LoRA trainer package for the LTX-2 audio–video generative model.
High-speed Large Language Model Serving for Local Deployment
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
Bayesian Modeling and Probabilistic Programming in Python