Repolode
Enviar
instavm

instavm/clickclickclick

A framework for autonomous Android and computer use, letting a planner and finder LLM operate phones and desktops from natural-language tasks.

Ver no GitHubSite
Estrelas
714
Forks
87
Issues abertas
3
Último commit
há 7 meses

O que é?

ClickClickClick is a Python framework that lets an LLM control an Android device or a computer to carry out tasks described in plain language, such as drafting an email in Gmail or starting a game on Lichess. It splits the work into a planner model that decides the next step and a finder model that locates the on-screen element to interact with, using ADB for Android and a macOS target for desktop.

The framework works with local models through Ollama (such as Llama 3.2-vision and qwen3.5:4b) as well as hosted models from Gemini and OpenAI, and models are configured in config/models.yaml. Tasks can be run from a CLI, a Gradio web interface, a Python API, or a REST endpoint served with uvicorn.

The project is labeled highly experimental, and the authors note the best results so far come from Gemini 3.1 Flash-Lite used as both planner and finder. Running Android tasks requires adb installed on the machine executing the code.

Recursos principais

  • 01Uses an LLM planner to break a task into steps and a finder to locate UI elements.
  • 02Supports local models via Ollama as well as Gemini and OpenAI.
  • 03Controls Android devices through ADB and macOS desktops.
  • 04Offers a CLI, Gradio web UI, Python API and REST endpoint.
  • 05Lets you tune image quality to trade accuracy for speed.

Casos de uso

  • Automating repetitive phone tasks such as sending messages or opening apps.
  • Experimenting with computer-use agents using local open models.
  • Prototyping LLM-driven UI automation on Android or macOS.
  • Exposing device automation as an HTTP service for other tools.

Tópicos

#ai-agents#computer-use#android-automation#llm#ollama#gemini#openai#automation#agents#ai-agents-framework

Perguntas frequentes

O que é clickclickclick?
A framework for autonomous Android and computer use, letting a planner and finder LLM operate phones and desktops from natural-language tasks. ClickClickClick is a Python framework that lets an LLM control an Android device or a computer to carry out tasks described in plain language, such as drafting an email in Gmail or starting a game on Lichess. It splits the work into a planner model that decides the next step and a finder model that locates the on-screen element to interact with, using ADB for Android and a macOS target for desktop.
clickclickclick é gratuito? Qual é a licença?
clickclickclick é open source sob a licença MIT. Confira os termos da licença antes de usá-lo em produtos comerciais.
clickclickclick ainda é mantido?
Sem commits há mais de 6 meses. O último commit de clickclickclick foi em 17 de mar. de 2026.
Para que posso usar clickclickclick?
Automating repetitive phone tasks such as sending messages or opening apps. Experimenting with computer-use agents using local open models. Prototyping LLM-driven UI automation on Android or macOS. Exposing device automation as an HTTP service for other tools.
Onde consigo clickclickclick?
O código-fonte e as instruções de instalação estão no GitHub: https://github.com/instavm/clickclickclick

Resumo gerado por IA a partir do README do projeto. As estatísticas do GitHub são atualizadas diariamente.

Projetos relacionados