1.triton-inference-server / serverThe Triton Inference Server provides an optimized cloud and edge inferencing solution. inferencegpumachine-learningdeep-learningclouddatacenter+1 morePythonBSD-3-CLAUSE11K total1.9K forks+533 starsfrom 10,589 · score 6.28