DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
47,133 repositories indexed
1–22 of 22 · Most stars
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Rayon: A data parallelism library for Rust
A General-purpose Task-parallel Programming System in C++
- parallel-programming
- threadpool
- concurrent-programming
- high-performance-computing
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
A Ruby/Rack web server built for parallelism
- ruby
- server
- multithreading
- rack
SSH.NET is a Secure Shell (SSH) library for .NET, optimized for parallelism.
Image processing algorithms in pure Go
- algorithm
- parallelism
- histogram
- image-processing
The C++ Standard Library for Parallelism and Concurrency
- c-plus-plus
- distributed
- cross-platform
- parallelism
jOOλ - The Missing Parts in Java 8 jOOλ improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. The JDK 8's main efforts (default methods, lambdas, and the Stream API) were focused around maintaining backwards compatibility and implementing a functional API for parallelism.
使用稠密算力卡对稀疏大显存主机进行加速，主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
- llama-cpp
- pipeline-parallelism
- prefill-decode
- rtx-3060
Parallel Collectors is a toolkit easing parallel collection processing in Java using Stream API.
- parallelism
- parallel-streams
- stream-api
- hacktoberfest
Knapsack splits tests evenly across parallel CI nodes to run fast CI build and save you time.
- ruby
- rspec
- cucumber
- minitest
An easy-to-use and fast library for task-based parallelism, utilizing coroutines.
- coroutines
- cpp
- parallel-computing
A collection of useful utility functions
- utility
- utilities
- string
- strings
Parallelism for Common Lisp
The GPars concurrency and parallelism framework for the JVM
:zap: Fast Concurrent / Parallel Sorting in Go
- concurrency
- golang
- sorting
- parameter-tuning
A simple scheduler for OCaml 5
- effects
- ocaml
- parallelism
- scheduler
A parallelized stream implementation for Elixir
- stream
- elixir
- parallelize
- parallelism
Parallelism for Common Lisp
Lightweight AI agent runtime for Go. Define multi-agent crews in YAML, run them with goroutines and channels, and let the runtime handle scheduling, parallelism, retries, and observability — without leaving the Go ecosystem.