SGLang is an open-source inference framework for serving large language, vision-language, and diffusion models on many GPU, TPU, and CPU platforms.
37.5K9.7KPythonApache-2.0Updated 5 hours ago
#blackwell
Open-source projects tagged “blackwell”
Curated GitHub repositories related to blackwell, with AI summaries and key stats.
Sort:Recently added
2 repositories
A fast, memory-efficient library and server for running and serving large language models with an OpenAI-compatible API.
94.2K23.6KPythonApache-2.0Updated 5 hours ago