A toolkit for compressing, deploying, and serving LLMs and vision-language models, with TurboMind and PyTorch inference engines.
8.1K767PythonApache-2.0Updated 4 hours ago
#codellama
Curated GitHub repositories related to codellama, with AI summaries and key stats.
A toolkit for compressing, deploying, and serving LLMs and vision-language models, with TurboMind and PyTorch inference engines.