Inference code for EAGLE-4, a speculative decoding harness that speeds up LLM serving on SGLang, vLLM and TokenSpeed.
2296PythonOtherUpdated 11 hours ago
#tokenspeed
Open-source projects tagged “tokenspeed”
Curated GitHub repositories related to tokenspeed, with AI summaries and key stats.