A research framework for CPU-GPU heterogeneous LLM inference and LoRA/full fine-tuning of large MoE models on limited GPU memory.
19.6K1.6KPythonApache-2.0Updated 2 days ago
#cpu-offload
Open-source projects tagged “cpu-offload”
Curated GitHub repositories related to cpu-offload, with AI summaries and key stats.