A Kubernetes operator for deploying and managing LLM serving, with GPU scheduling and model lifecycle handling for SGLang, vLLM, TensorRT-LLM and Triton.
518104GoApache-2.0Updated 14 hours ago
#gpu-scheduling
Curated GitHub repositories related to gpu-scheduling, with AI summaries and key stats.
A Kubernetes operator for deploying and managing LLM serving, with GPU scheduling and model lifecycle handling for SGLang, vLLM, TensorRT-LLM and Triton.
Cloud-native MLOps platform on Kubernetes: notebooks, drag-and-drop pipelines, distributed training and LLM serving.