A C++ LLM inference server for consumer GPUs and mixed AMD/NVIDIA machines, using speculative decoding, speculative prefill and custom kernels.
3K+3 this week286C++Apache-2.0Updated 19 hours ago
#dflash
Open-source projects tagged “dflash”
Curated GitHub repositories related to dflash, with AI summaries and key stats.