Datacenter-scale distributed inference serving framework that orchestrates vLLM, SGLang and TensorRT-LLM across multiple GPUs and nodes.
8.4K1.8KRustOtherUpdated 8 hours ago
#omni
Open-source projects tagged “omni”
Curated GitHub repositories related to omni, with AI summaries and key stats.