Hackable and optimized Transformers building blocks, supporting a composable construction.
Repository Index
65,764 visible repositories in the index
49–72 of 187 · Most stars
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- python
- fine-tuning
- gguf
- huggingface
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
- semantic-segmentation
- pytorch
- pspnet
- deeplabv3
A PyTorch implementation of the Transformer model in "Attention is All You Need".
- attention
- deep-learning
- attention-is-all-you-need
- pytorch
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
- diffusion
- dit
- pytorch
- sana
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
- semantic-segmentation
- image-segmentation
- image-matting
- interactive-segmentation
Common used path planning algorithms with animations.
- astar
- anytime-repairing-astar
- learning-realtime-astar
- realtime-adaptive-astar
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
- chatgpt
- deep-learning
- instruction-following
- language-model
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
- apple-silicon
- audio-processing
- mlx
- multimodal
BertViz: Visualize Attention in Transformer Models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
- bert
- transformers
- topic-modeling
- sentence-embeddings
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
- ingestion-api
- ocr
- omniparser
- parse-server
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
- artificial-intelligence
- attention-mechanisms
- deep-learning
- reinforcement-learning
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
Chinese version of GPT2 training code, using BERT tokenizer.
- transformer
- gpt-2
- chinese
- nlp
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
- deepspeed-library
- gpt-3
- transformers
- language-model
SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing
- sdnext
- ai-art
- caption
- diffusers
[ICCV 2023] ProPainter: Improving Propagation and Transformer for Video Inpainting
- object-removal
- video-completion
- video-inpainting
- video-outpainting
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
- document-ai
- eccv-2022
- multimodal-pre-trained-model
- ocr
TranslatedE-book "Large Models and Agents" (《大模型与智能体》) with 6 programming tasks: Transformer, mini-GPT, SFT/DPO, RAG, tool calling, and coding agents.
Open-source offline translation library written in Python
- python
- machine-translation
- transformers
- translation