#llama-cpp

Open-source projects tagged “llama-cpp”

Curated GitHub repositories related to llama-cpp, with AI summaries and key stats.

Sort:Recently added

Recently added
Most stars
Recently updated
Most forks

3 repositories

StayLameBro / backburner

Uses an iPhone connected over USB-C to speed up prefill and extend context for a 27B Qwen model running locally on a Mac.

AI & Machine Learning #local-llm #apple-silicon #llm-inference #llama-cpp #ios

1K116PythonMITUpdated 5 days ago

XHToken / Spark-X2.5

GitHub

Spark-X2.5 is an open-weight language model series (4B and 1.7B) aimed at agentic coding and tool use on local and on-device hardware.

AI & Machine Learning #llm #ai-agent #on-device #local-llm #vllm

812110Apache-2.0Updated 29 days ago

ARahim3 / DigUp

GitHub

Desktop app that searches your local files by meaning, across photos, PDFs, documents, audio, video and code, running on-device with EmbeddingGemma 2.

Productivity & Apps #semantic-search #embeddings #file-search #on-device #local-first

4.8K339SwiftMITUpdated 19 hours ago