SGLang is an open-source inference framework for serving large language, vision-language, and diffusion models on many GPU, TPU, and CPU platforms.
37.5K9.7KPythonApache-2.0Updated 6 hours ago
#serving
Open-source projects tagged “serving”
Curated GitHub repositories related to serving, with AI summaries and key stats.