Recipe for serving DeepSeek-V4.1-Flash-1017 (EXL3 2.9 bpw) across two NVIDIA DGX Sparks as an OpenAI-compatible API with a 1M-token window.
13421ShellApache-2.0Updated 16 hours ago
#exllama
Open-source projects tagged “exllama”
Curated GitHub repositories related to exllama, with AI summaries and key stats.