Open-source projects tagged “llama-cpp”

A macOS menu bar app for running local LLMs, built on llama.cpp, with a local API server and built-in WebUI.

Local inference engine that runs the large Qwen3.8-Flash-Next model on consumer NVIDIA or AMD GPUs under Windows or Linux, with OpenAI and Anthropic compatible APIs.

Pairs an iPhone with a Mac over USB-C so the phone's GPU helps run a Qwen 27B model locally, speeding up prompt reading and extending context.

A self-hosted AI health data engine that standardizes lab reports, wearable data and genetic files into one traceable record, with an MCP server.

Open-weight 4B and 1.7B general-purpose language models from XHToken, aimed at on-device use and agentic tool-calling workflows.

Local, on-device file search that finds photos, PDFs, documents, recordings, videos and code by describing what's in them, on Mac, Windows and Linux.