Repolode
Submit
kellyvv

kellyvv/PhoneClaw

An iOS app and Swift framework that runs Gemma and MiniCPM-V models on iPhone as a local AI agent with native Calendar, Reminders, Contacts and Health skills.

Open-source alternative to:Siri

View on GitHubWebsite
Stars
1,280
Forks
169
Open issues
3
Last commit
3 months ago

What is it?

PhoneClaw is a local AI agent framework for iPhone written in Swift. It runs Gemma 4 E2B and E4B models through LiteRT-LM and the MiniCPM-V 4.6 multimodal model on the device, so chat, translation and tool calls work without sending personal data to a server by default.

The agent is organized as Skills. Built-in native Skills cover Calendar, Reminders, Contacts, Clipboard, HealthKit data, image questions, voice input and a real-time LIVE mode with camera input. Each Skill is defined in a SKILL.md file, and custom Skills can be added by placing that file in the app's data directory and hot-reloading it. Web search and webpage reading are available only when the user explicitly triggers them.

Optionally, a companion Mac Gateway app advertised over Bonjour lets a paired iPhone send inference requests to Ollama, Codex CLI or Antigravity CLI running on a Mac on the same LAN. The project supports iOS 17 and later and builds with Xcode 16 and CocoaPods.

Key features

  • 01Runs Gemma 4 E2B/E4B via LiteRT-LM and MiniCPM-V 4.6 on iPhone
  • 02Native Skills for Calendar, Reminders, Contacts, Clipboard and HealthKit
  • 03Skills defined in SKILL.md files with hot reload
  • 04LIVE mode with voice input and camera-based scene understanding
  • 05Optional LAN inference through a paired Mac running Ollama or CLI tools

Use cases

  • Managing schedules, reminders and contacts by voice or text on iPhone without a cloud account
  • Summarizing personal Health data from HealthKit on-device
  • Prototyping mobile agent Skills with a Markdown-based format
  • Offloading larger model inference to a Mac on the same network

Quick start

  1. 1

    Install from TestFlight

Things to know

  • Requires an iPhone running iOS 17.0 or later; building from source needs macOS, Xcode 16 and CocoaPods.
  • Gemma 4 E4B needs an iPhone 15 Pro or newer, and MiniCPM-V 4.6 is recommended for A17 Pro or newer.
  • Sideloaded builds have a memory cap that limits E4B to CPU, so the E2B model is recommended there.
  • Mac remote inference requires a paired Mac on the same local network.

Topics

#ios#swift#on-device-ai#local-llm#mobile-agent#gemma#litert#ollama#agent-framework#ai-agent

FAQ

What is PhoneClaw?
An iOS app and Swift framework that runs Gemma and MiniCPM-V models on iPhone as a local AI agent with native Calendar, Reminders, Contacts and Health skills. PhoneClaw is a local AI agent framework for iPhone written in Swift. It runs Gemma 4 E2B and E4B models through LiteRT-LM and the MiniCPM-V 4.6 multimodal model on the device, so chat, translation and tool calls work without sending personal data to a server by default.
Is PhoneClaw free to use? What license does it have?
PhoneClaw is open source under the Apache-2.0 license. Check the license terms before using it in commercial products.
Is PhoneClaw still maintained?
Updated within 6 months. The last commit to PhoneClaw was on Aug 6, 2026.
What can I use PhoneClaw for?
Managing schedules, reminders and contacts by voice or text on iPhone without a cloud account Summarizing personal Health data from HealthKit on-device Prototyping mobile agent Skills with a Markdown-based format Offloading larger model inference to a Mac on the same network
How do I install PhoneClaw?
Install from TestFlight
Where can I get PhoneClaw?
The source code and installation instructions are on GitHub: https://github.com/kellyvv/PhoneClaw

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects