Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
47,133 repositories indexed
1–24 of 26 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
:zap: A Fast, Extensible Progress Bar for Python and CLI
- progressbar
- progressmeter
- progress-bar
- meter
Bend 2: a fast language that blocks AI mistakes via proof. Install: curl -fsSL https://bend-lang.com/install.sh | sh
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
- paddlepaddle
- deep-learning
- scalability
- machine-learning
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
A hyperparameter optimization framework
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Parallel computing with task scheduling
- dask
- python
- pydata
- numpy
NumPy aware dynamic Python compiler using LLVM
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
:stuck_out_tongue_closed_eyes: TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
- speech-synthesis
- text-to-speech
- tensorflow2
- melgan
ILGPU JIT Compiler for high-performance .Net GPU programs
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
- reinforcement-learning
- parallel-processing
- cpp17
- pybind11
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
- database
- data-analysis
- data-warehouse
- olap
:chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions
- adaptive-learning
- machine-learning
- python
- live-plots
GRASS - free and open-source geospatial processing engine
- grass-gis
- geospatial
- geospatial-analysis
- raster
:four_leaf_clover: Evolutionary optimization library for Go (genetic algorithm, partical swarm optimization, differential evolution)
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
- hpc
- workflow
- workflow-automation
- workflow-management
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
- pipeline
- pipeline-framework
- machine-learning
- deep-learning
A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.
- optimization
- optimization-algorithms
- optimization-methods
- optimization-problem
Exascale multiphase flow solver — 2025 Gordon Bell Prize Finalist | 200T grid points on 43K+ GPUs
- gpu
- exascale
- cfd
- fortran
Go's answer to pandas + scikit-learn: a batteries-included data analysis library with dataframes, statistics, machine learning, quant, and GPU acceleration. Run Python with seamless two-way variable sharing, or explore data straight from the Insyra CLI.
- parallel
- data-science
- go-echarts
- data-visualization