1.triton-inference-server / serverThe Triton Inference Server provides an optimized cloud and edge inferencing solution. inferencegpumachine-learningdeep-learningclouddatacenter+1 morePythonBSD-3-CLAUSE11K total1.9K forks+241 starsfrom 10,881 · score 5.49