A high-performance neural network inference framework in C++ for running deep learning models on mobile, embedded, and desktop devices.
24K4.5KC++OtherUpdated yesterday
2 alternatives
Looking for a free, open-source alternative to TensorFlow Lite? These 2 projects can replace it. Each one passed our quality screening and is explained in plain words, so you can compare stars, license and maintenance at a glance.
| Project | Stars | License | Last commit |
|---|---|---|---|
| Tencent/ncnn | ★ 24K | Other | yesterday |
| alibaba/MNN | ★ 16.3K | Apache-2.0 | 7 hours ago |
A high-performance neural network inference framework in C++ for running deep learning models on mobile, embedded, and desktop devices.
MNN is a lightweight deep learning inference and training engine from Alibaba, designed for running models on mobile and embedded devices, including on-device LLMs.