“llama-cpp” 相关开源项目

A macOS menu bar app for running local LLMs, built on llama.cpp and serving an OpenAI-style API on localhost.

在家用 NVIDIA 或 AMD 显卡上本地运行大参数 Qwen3.8-Flash-Next 模型的推理引擎，提供兼容 OpenAI 与 Anthropic 的本地 API。

Uses an iPhone connected over USB-C to speed up prefill and extend context for a 27B Qwen model running locally on a Mac.

Spark-X2.5 is an open-weight language model series (4B and 1.7B) aimed at agentic coding and tool use on local and on-device hardware.

Desktop app that searches your local files by meaning, across photos, PDFs, documents, audio, video and code, running on-device with EmbeddingGemma 2.