A toolkit for compressing, deploying, and serving LLMs and vision-language models, with TurboMind and PyTorch inference engines.
8.1K767PythonApache-2.0Updated 5 hours ago
#cuda-kernels
Open-source projects tagged “cuda-kernels”
Curated GitHub repositories related to cuda-kernels, with AI summaries and key stats.