A GPU communication library for expert-parallel MoE dispatch and combine, with FP8 dispatch and NVLink/RDMA support for training and inference.
10.3K1.5KCudaMITUpdated 4 days ago
#nccl
Curated GitHub repositories related to nccl, with AI summaries and key stats.
A GPU communication library for expert-parallel MoE dispatch and combine, with FP8 dispatch and NVLink/RDMA support for training and inference.