A GPU communication library for expert-parallel MoE dispatch and combine, with FP8 dispatch and NVLink/RDMA support for training and inference.
10.3K1.5KCudaMITUpdated 4 days ago
#expert-parallelism
Open-source projects tagged “expert-parallelism”
Curated GitHub repositories related to expert-parallelism, with AI summaries and key stats.