A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
47,133 repositories indexed
1–24 of 39 · Most stars
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- pytorch
- resnet
- pretrained-models
- pretrained-weights
Open-Sora: Democratizing Efficient Video Production for All
Fast and memory-efficient exact attention
An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
- bigvgan
- cross-lingual
- indextts
- text-to-speech
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
- adapter
- diffusion
- llm
- parameter-efficient-learning
⚡️HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。
- demo
- gradio
- idphoto
- machine-learning
🎬 卡卡字幕助手 | VideoCaptioner - 基于 LLM 的智能字幕助手 - 视频字幕生成、断句、校正、字幕翻译全流程处理！- A powered tool for easy and efficient video subtitling.
- ai
- subtitle
- translate
- video-subtile
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
- audio-driven-talking-face
- cvpr2023
- talking-head
- deep-fake
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
Efficiently computes derivatives of NumPy code.
- autograd
- automatic-differentiation
- numpy
- python
A community-driven, open-source project to share detection logic, adversary tradecraft and resources to make detection development more efficient.
- threat-hunting
- sysmon
- hunting-campaigns
- hypothesis
A unified, comprehensive and efficient recommendation library
- recommender-systems
- collaborative-filtering
- knowledge-graph
- ctr-prediction
Build powerful, efficient, and flexible GraphQL APIs with seamless Django integration.
A highly efficient implementation of Gaussian Processes in PyTorch
- pytorch
- gaussian-processes
- gpu-acceleration
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2
- pytorch
- protein-structure
- alphafold2
A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
- pandas
- pandas-dataframe
- parallel-computing
- parallelization
Official repository for MOSS-Image, a 5B-parameter base DiT model with high-quality text rendering, layout generation, and efficient fine-tuning.
- controllable-generation
- foundation-models
- image-generation
- text-rendering
High level network definitions with pre-trained weights in TensorFlow
- tensorflow
- model
- zoo
- deep-learning