Open-source projects tagged “int4”

An LLM and VLM post-training quantization toolkit from Intel that compresses models to low-bit weights for Transformers, vLLM and SGLang.

Intel's open-source Python library for compressing deep learning models via quantization, sparsity and distillation across PyTorch, JAX and ONNX.