A GPU kernel library and generator for LLM inference, providing unified APIs for attention, GEMM, MoE, and sampling operations.
6.8K+10 this week1.6KCudaApache-2.0Updated 13 hours ago
#large-large-models
Curated GitHub repositories related to large-large-models, with AI summaries and key stats.
A GPU kernel library and generator for LLM inference, providing unified APIs for attention, GEMM, MoE, and sampling operations.