DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
47,133 repositories indexed
1–24 of 58 · Most stars
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
- meeting-minutes
- meeting-notes
- llm
- mac
GUI for a Vocal Remover that uses Deep Neural Networks.
- vocal-remover
- pytorch
- source
- separation
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
- paddlepaddle
- deep-learning
- scalability
- machine-learning
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
- pytorch
- speech-recognition
- paraformer
- punctuation
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
A hyperparameter optimization framework
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Parallel computing with task scheduling
- dask
- python
- pydata
- numpy
Machine Learning Interviews from FAANG, Snapchat, LinkedIn. I have offers from Snapchat, Coupang, Stitchfix etc. Blog: mlengineer.io.
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
- attention
- pytorch
- paper
- cbam
A PyTorch-based Speech Toolkit
- speech-recognition
- speech-toolkit
- speaker-recognition
- speech-to-text
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
- machine-learning
- experiment-track
- deep-learning
- keras
NumPy aware dynamic Python compiler using LLVM
Fast and Accurate ML in 3 Lines of Code
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
- cloud-computing
- deep-learning
- gpu
- hyperparameter-tuning
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
Automated Machine Learning with scikit-learn
- automl
- scikit-learn
- automated-machine-learning
- hyperparameter-optimization
:stuck_out_tongue_closed_eyes: TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
- speech-synthesis
- text-to-speech
- tensorflow2
- melgan
AI Infra / AI Orchestration / AI Control Plane