A Python library for compressing LLMs through quantization and pruning, producing checkpoints that load directly into vLLM for inference.
3.9K707PythonApache-2.0Updated 2 hours ago
#gptq
Open-source projects tagged “gptq”
Curated GitHub repositories related to gptq, with AI summaries and key stats.