A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
54,641 visible repositories in the index
1–4 of 4 · Most stars
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
This Repository Contain All the Artificial Intelligence Projects such as Machine Learning, Deep Learning and Generative AI that I have done while understanding Advanced Techniques & Concepts.
- computer-vision-projects
- deep-learning-projects
- machine-learning-projects
- machinelearningprojects
An open, programmable decision layer for models and compute.
- mixture-of-models
- semantic-router
- vllm
- ai-gateway