Open-source projects tagged “mobile-inference”

A C++ inference engine and runtime for running LLM, speech and vision models on phones, wearables, smart home devices and robots.

A React Native library for running machine learning models directly on phones with no network calls, built on Meta's ExecuTorch runtime.