A pure C inference engine that runs very large mixture-of-experts models on ordinary hardware by streaming routed experts from disk.
42.8K4.8KCApache-2.0Updated 19 hours ago
#offloading
Open-source projects tagged “offloading”
Curated GitHub repositories related to offloading, with AI summaries and key stats.