1.apache / sparkApache Spark - A unified analytics engine for large-scale data processingpythonscalarjavabig-datajdbc+2 moreScalaAPACHE-2.044K total30K forks+319 starsfrom 44,087 · score 5.77
2.ray-project / rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.raydistributedparallelmachine-learningreinforcement-learningdeep-learning+14 morePythonAPACHE-2.044K total8.2K forks+269 starsfrom 43,926 · score 5.60
3.apache / hadoopApache HadoophadoopJavaAPACHE-2.016K total9.2K forks+39 starsfrom 15,670 · score 3.69
4.apache / shardingsphereEmpowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.databasedistributed-databasedistributed-sql-databasesqlsharddatabase-cluster+10 moreJavaAPACHE-2.021K total6.9K forks+25 starsfrom 20,792 · score 3.26
5.dask / daskParallel computing with task schedulingdaskpythonpydatanumpypandasscikit-learn+1 morePythonBSD-3-CLAUSE14K total2K forks+18 starsfrom 13,924 · score 2.94