A Python library for training speculative decoding draft models that deploy directly into the vLLM inference engine.
920+2 this week271PythonApache-2.0Updated yesterday
#draft-model
Curated GitHub repositories related to draft-model, with AI summaries and key stats.
A Python library for training speculative decoding draft models that deploy directly into the vLLM inference engine.