A GPU kernel library and generator for LLM inference, providing unified APIs for attention, GEMM, MoE, and sampling operations.
6.8K+10 this week1.6KCudaApache-2.0Updated 13 hours ago
#kernels
Curated GitHub repositories related to kernels, with AI summaries and key stats.
A GPU kernel library and generator for LLM inference, providing unified APIs for attention, GEMM, MoE, and sampling operations.