Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
47,133 repositories indexed
1–24 of 31 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
:zap: A Fast, Extensible Progress Bar for Python and CLI
- progressbar
- progressmeter
- progress-bar
- meter
A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support
A hyperparameter optimization framework
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Parallel computing with task scheduling
- dask
- python
- pydata
- numpy
NumPy aware dynamic Python compiler using LLVM
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Computing with Python functions.
- python
- parallel-computing
- caching
- multiprocessing
:stuck_out_tongue_closed_eyes: TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
- speech-synthesis
- text-to-speech
- tensorflow2
- melgan
A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
- pandas
- pandas-dataframe
- parallel-computing
- parallelization
The open-source governance layer for AI agents: write the rules declaratively, Bernstein enforces them and produces the verifiable, replayable record. Free, Apache-2.0. https://bernstein.run
- agent-orchestrator
- deterministic-replay
- air-gap
- audit-trail
Asynchronous parallel SSH client library.
Coordinate Claude, Codex and Cursor windows with shared tasks, acknowledgements, prechecks, parallel tests, source-bound proofs and independent review. Built-in skills recall lessons, simplify code and forecast work. Track progress, decisions and evidence in a bilingual local dashboard, with MCP plugins. Browse skills and verified security audits.
:chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions
- adaptive-learning
- machine-learning
- python
- live-plots
Python bindings for MPI
- python
- parallel-computing
- mpi
- mpi-library
AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
- hpc
- workflow
- workflow-automation
- workflow-management
FiPy is a Finite Volume PDE solver written in Python
- scientific-computing
- scientific-computing-with-python
- phase-field
- materials-science
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
- pipeline
- pipeline-framework
- machine-learning
- deep-learning
Parallel uploads to Amazon AWS S3
40K, small memory footprint, single binary that run list of commands in parallel and waits for their termination