Repolode
Submit
google-ai-edge

google-ai-edge/gallery

An Android and iOS app from Google AI Edge for trying open-source LLMs and on-device GenAI use cases offline on your phone.

Open-source alternative to:ChatGPT

View on GitHub
Stars
25,048
Forks
2,759
Open issues
468
Last commit
13 hours ago

What is it?

Google AI Edge Gallery is a mobile app that runs large language models and other generative AI models directly on the device, with no internet connection needed for inference. It serves as a sandbox where users can download models from a built-in list or load their own, then try them in chat, image, audio, and video scenarios.

The app includes several demo features: multi-turn chat with a Thinking Mode that shows step-by-step reasoning on supported Gemma 4 models, Ask Image for questions about photos or camera input, Audio Scribe for transcription and translation, and Prompt Lab for single-turn prompt testing with parameters such as temperature and top-k. It also offers on-device media search and a video moment finder built on EmbeddingGemma 2, plus Agent Skills that can load extra tools from a URL.

The project is built on Google AI Edge and LiteRT, and it integrates with Hugging Face for model discovery and download. Users can run benchmarks to compare how models perform on their own hardware. The app requires Android 12 or later, or iOS 17 or later.

Key features

  • 01Runs LLMs and other generative models fully offline on the device.
  • 02Multi-turn chat with a Thinking Mode that shows reasoning steps on supported models.
  • 03Ask Image answers questions about photos or camera input.
  • 04Audio Scribe transcribes and translates voice recordings.
  • 05Prompt Lab tests single-turn prompts with adjustable temperature and top-k.
  • 06Loads models from a built-in list, Hugging Face, or custom files, and benchmarks them on your hardware.

Use cases

  • Evaluating which open-source models run acceptably on a specific phone.
  • Prototyping offline AI features before building them into your own mobile app.
  • Private photo search or image questions where data should not leave the device.
  • Testing prompts and model parameters without writing code.

Quick start

  1. 1

    Check OS requirement: Android 12 and up, or iOS 17 and up

  2. 2

    Install the app from Google Play or the App Store

  3. 3

    For users without Google Play access, install the APK from the latest GitHub release

  4. 4

    See the Project Wiki for detailed installation instructions and a user guide

Things to know

  • This is an experimental Beta release.
  • Thinking Mode only works with supported models, starting with the Gemma 4 family.
  • The README does not describe a desktop or cross-platform build; the macOS download is a separate app package.

Topics

#on-device-ai#llm#mobile#offline#litert#gemma#multimodal#android

FAQ

What is gallery?
An Android and iOS app from Google AI Edge for trying open-source LLMs and on-device GenAI use cases offline on your phone. Google AI Edge Gallery is a mobile app that runs large language models and other generative AI models directly on the device, with no internet connection needed for inference. It serves as a sandbox where users can download models from a built-in list or load their own, then try them in chat, image, audio, and video scenarios.
Is gallery free to use? What license does it have?
gallery is open source under the Apache-2.0 license. Check the license terms before using it in commercial products.
Is gallery still maintained?
Actively maintained. The last commit to gallery was on Oct 20, 2026.
What can I use gallery for?
Evaluating which open-source models run acceptably on a specific phone. Prototyping offline AI features before building them into your own mobile app. Private photo search or image questions where data should not leave the device. Testing prompts and model parameters without writing code.
How do I install gallery?
Check OS requirement: Android 12 and up, or iOS 17 and up Install the app from Google Play or the App Store For users without Google Play access, install the APK from the latest GitHub release See the Project Wiki for detailed installation instructions and a user guide
Where can I get gallery?
The source code and installation instructions are on GitHub: https://github.com/google-ai-edge/gallery

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects