A GPU communication library for expert-parallel MoE dispatch and combine, with FP8 dispatch and NVLink/RDMA support for training and inference.
10.3K1.5KCudaMITUpdated 4 days ago
#rdma
Curated GitHub repositories related to rdma, with AI summaries and key stats.
A GPU communication library for expert-parallel MoE dispatch and combine, with FP8 dispatch and NVLink/RDMA support for training and inference.
Pools the devices you own into one AI cluster so large models can run locally across multiple Macs and other machines.