C++ and Python library that runs Transformer models such as Whisper, Llama and NLLB faster and with less memory via quantization and optimized kernels.
4.7K547C++MITUpdated 6 hours ago
#transformer-models
Open-source projects tagged “transformer-models”
Curated GitHub repositories related to transformer-models, with AI summaries and key stats.