On-device LLM and VLM inference runtime for Qualcomm Snapdragon devices, running models on the NPU, GPU, or CPU via CLI, Python, Android, Docker, or an OpenAI-compatible server.
8.5K1.1KGoBSD-3-ClauseUpdated 2 hours ago
#qualcomm
Curated GitHub repositories related to qualcomm, with AI summaries and key stats.
On-device LLM and VLM inference runtime for Qualcomm Snapdragon devices, running models on the NPU, GPU, or CPU via CLI, Python, Android, Docker, or an OpenAI-compatible server.