C++ and Python library that runs Transformer models such as Whisper, Llama and NLLB faster and with less memory via quantization and optimized kernels.
4.7K547C++MITUpdated yesterday
#avx
Curated GitHub repositories related to avx, with AI summaries and key stats.
C++ and Python library that runs Transformer models such as Whisper, Llama and NLLB faster and with less memory via quantization and optimized kernels.