An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.
14.6K1.5KPythonApache-2.0Updated 17 hours ago
#glm
Curated GitHub repositories related to glm, with AI summaries and key stats.
An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.