A macOS menu bar app for running local LLMs, built on llama.cpp, with a local API server and built-in WebUI.
1.7K130SwiftMITUpdated 2 days ago
#openai-compatible-api
Curated GitHub repositories related to openai-compatible-api, with AI summaries and key stats.
A macOS menu bar app for running local LLMs, built on llama.cpp, with a local API server and built-in WebUI.