A GPU communication library for expert-parallel MoE dispatch and combine, with FP8 dispatch and NVLink/RDMA support for training and inference.
10.3K1.5KCudaMITUpdated 4 days ago
Language
Best open-source Cuda projects
Open-source projects written in Cuda, ranked by stars with AI summaries and license info.
Sort:Recently added
2 repositories
An open-source book and code collection of modern CUDA learning notes, with 200+ kernels covering HGEMM, FP8/FP4 GEMM, and Flash-Attention.
12.1K1.3KCudaGPL-3.0Updated 16 hours ago