Open-source inference server that deploys AI models from TensorRT, PyTorch, ONNX, OpenVINO and other frameworks over HTTP/REST and gRPC.
11.1K1.9KPythonBSD-3-ClauseUpdated 7 hours ago
#datacenter
Curated GitHub repositories related to datacenter, with AI summaries and key stats.
Open-source inference server that deploys AI models from TensorRT, PyTorch, ONNX, OpenVINO and other frameworks over HTTP/REST and gRPC.