DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
57,138 visible repositories in the index
1–24 of 26 · Most stars
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- artificial-intelligence
- attention-mechanism
- transformers
- computer-vision
A 100% free modern JS SaaS boilerplate (React, NodeJS, Prisma). Full-featured: Auth (email, google, github, slack, MS), Email sending, Background jobs, Landing page, Payments (Stripe, Polar.sh), Shadcn UI, S3 file upload. AI-ready with tailored AGENTS.md, skills, and Claude Code plugin. One cmd deploy. Powered by Wasp full-stack framework.
- full-stack
- open-source
- saas
- nodejs
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
- attention
- pytorch
- paper
- cbam
all kinds of text classification models and more with deep learning
- classification
- nlp
- fasttext
- textcnn
A concise but complete full-attention transformer with a set of promising experimental features from various papers
- artificial-intelligence
- deep-learning
- attention-mechanism
- transformers
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
- artificial-intelligence
- deep-learning
- attention-mechanism
- text-to-image
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code
- text-to-speech
- diffusion-speedup
- tts
- aaai2022
A Collection of Cheatsheets, Books, Questions, and Portfolio For DS/ML Interview Prep
- data-science
- machine-learning
- deep-learning
- data-portfolio
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
- ai
- ai-ocr
- gnn
- graph
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
- diffusion-models
- high-resolution
- sparse-attention
- video-generation
Natural language processing framework for Ruby.
Scalable, event-driven, deep-learning-friendly backtesting library
- reinforcement-learning
- deep-reinforcement-learning
- gym-environment
- openai-gym
TensorFlow Implementation of "Show, Attend and Tell"
- tensorflow
- image-captioning
- show-attend-and-tell
- attention-mechanism
Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding && Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities
Code for PaperRobot: Incremental Draft Generation of Scientific Ideas
- pytorch
- memory-networks
- generation
- end-to-end-learning
Style Art library process images using COREML with a set of pre trained machine learning models and convert them to Art style.
- coreml
- prisma
- neural-network
- ios
TransformerCPI: Improving compound–protein interaction prediction by sequence-based deep learning with self-attention mechanism and label reversal experiments(BIOINFORMATICS 2020) https://doi.org/10.1093/bioinformatics/btaa524
- self-attention
- compound-protein-interaction
- transformercpi
- structure-free-virtual-sreening
PrismQuant: Optimal Null-Space Rotations for Grouped Quantizers
- int4
- large-language-models
- pytorch
- quantization
Hierarchical Attentive Recurrent Tracking
- neural-nets
- object-tracking
- attention-mechanism
- rnn
TensorFlow implementation of the paper "Hierarchical Attention Networks for Document Classification"
- text-classification
- sentiment-analysis
- hierarchical-attention-networks
- document-classification