An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.
14.6K1.5KPythonApache-2.0Updated 10 hours ago
#moe
Curated GitHub repositories related to moe, with AI summaries and key stats.
An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.
A pure C inference engine that runs very large mixture-of-experts models on ordinary hardware by streaming routed experts from disk.