An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs and CPUs.
1.5만1.5천PythonApache-2.0업데이트 4시간 전
#llm-serving
llm-serving 관련 엄선 GitHub 저장소. AI 요약과 주요 지표를 함께 제공합니다.
An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs and CPUs.