Python library that runs large language models layer by layer so 70B-class models can infer on a single 4GB GPU, without quantization.
39.5K4KJupyter NotebookApache-2.0Updated 14 hours ago
#low-vram
Open-source projects tagged “low-vram”
Curated GitHub repositories related to low-vram, with AI summaries and key stats.