An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.
14.6K1.5KPythonApache-2.0Updated 18 hours ago
#deepseek-v4
Curated GitHub repositories related to deepseek-v4, with AI summaries and key stats.
An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.