A Kubernetes operator for deploying and managing LLM serving, with GPU scheduling and model lifecycle handling for SGLang, vLLM, TensorRT-LLM and Triton.
518104GoApache-2.0Updated 16 hours ago
#kimi-k2
Curated GitHub repositories related to kimi-k2, with AI summaries and key stats.
A Kubernetes operator for deploying and managing LLM serving, with GPU scheduling and model lifecycle handling for SGLang, vLLM, TensorRT-LLM and Triton.