FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
Transfer Learning Library for Domain Adaptation, Task Adaptation, and Domain Generalization
- domain-adaptation
- transfer-learning
- finetune
- unsupervised-domain-adaptation
OpenDILab Decision AI Engine. The Most Comprehensive Reinforcement Learning Framework B.P.
A utility for managing proot containers.
- linux
- proot
- proot-distro
- python
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
A high-performance distributed training framework for Reinforcement Learning
D-FINE: Redefine Regression Task of DETRs as Fine-grained Distribution Refinement [ICLR 2025 Spotlight]
Accelerated deep learning R&D
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
A no-fluff and highly practical masterclass that reignites engineering curiosity and helps SDE-2, SDE-3, and above become great at designing, implementing, and shipping scalable, fault-tolerant, and highly available systems at the workplace.
- system-design-project
- system-design
- system-design-interview
- system-design-questions
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
- knowledge-distillation
- model-compression
- quantization
- pretrained-models
DDos Ripper a Distributable Denied-of-Service (DDOS) attack server that cuts off targets or surrounding infrastructure in a flood of Internet traffic
- ddos-attacks
- ddos-tool
- ddos-attack-tools
- ddos-protection
Fast job queuing and RPC in python with asyncio and redis.
MyPaint is a simple drawing and painting program that works well with Wacom-style graphics tablets.
- painting
- drawing
- art
- mypaint
Lingvo
Build, Store, and Distribute your Applications and Containers
OpenTelemetry Python API and SDK
Crankshaft: A turnkey GNU/Linux solution that transforms a Raspberry Pi to an Android Auto head unit.
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
Distributed self-replicating programs in Python
Machine learning metrics for distributed, scalable PyTorch applications.
an unhealthy amount of work has been put into this...star it?
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.