A cross-platform desktop AI assistant that connects to major LLM providers and acts as an MCP client with a local knowledge base.
aws-solutions/generative-ai-application-builder-on-aws
An AWS-provided solution that deploys a web dashboard for building, comparing and productionizing generative AI chat and agent use cases on Amazon Bedrock and SageMaker AI.
- Stars
- 358
- Forks
- 139
- Open issues
- 13
- Last commit
- 16 days ago
What is it?
Generative AI Application Builder on AWS is a deployable solution that gives admins a web-based dashboard to create, configure and compare generative AI use cases. Each use case is deployed as its own CloudFormation stack, and the dashboard lets teams try different LLM and configuration combinations side by side before taking one into production.
The current release covers chat use cases, including a chatbot-style UI that can query enterprise data through a knowledge base. Supported knowledge sources include Amazon Kendra and Knowledge Bases for Amazon Bedrock, and LLMs can be hosted on Amazon Bedrock or Amazon SageMaker AI. Agent use cases send requests to a configured Amazon Bedrock Agent. An API is available for custom end-user implementations.
The project is written in TypeScript with AWS CDK and includes React-based dashboard and chat UIs built with Vite. Deployment uses `cdk deploy` or a custom build that stages assets to S3.
Key features
- 01Web dashboard for deploying and comparing multiple LLM use cases
- 02Chat UI backed by knowledge bases via Amazon Kendra or Amazon Bedrock Knowledge Bases
- 03Integration with Amazon Bedrock and Amazon SageMaker AI as LLM providers
- 04Amazon Bedrock Agent use case support
- 05CloudWatch dashboards for multi-LLM metric tracking
- 06Modular nested CloudFormation stacks with optional VPC deployment
Use cases
- Piloting an internal chatbot that answers questions over company documents on AWS
- Comparing several foundation models on the same use case before choosing one for production
- Giving non-engineering teams a managed interface to launch and configure AI assistants
- Building a custom front end or integration on top of the provided chat API
Quick start
- 1
Install prerequisites (Docker, Node.js 20.x, CDK v2.118.0, Python 3.13.x, AWS CLI, jq)
- 2
Configure AWS CLI credentials, then bootstrap CDK in your account and region if not already done
cdk bootstrap - 3
Deploy the solution with CDK
cdk deploy
Things to know
- Requires an AWS account and incurs AWS service costs once deployed.
- Deployed use cases depend on AWS service availability and Amazon Bedrock model access must be requested first.
- Setup requires several prerequisites and familiarity with AWS CDK and CloudFormation.
In collections
Topics
FAQ
- What is generative-ai-application-builder-on-aws?
- An AWS-provided solution that deploys a web dashboard for building, comparing and productionizing generative AI chat and agent use cases on Amazon Bedrock and SageMaker AI. Generative AI Application Builder on AWS is a deployable solution that gives admins a web-based dashboard to create, configure and compare generative AI use cases. Each use case is deployed as its own CloudFormation stack, and the dashboard lets teams try different LLM and configuration combinations side by side before taking one into production.
- Is generative-ai-application-builder-on-aws free to use? What license does it have?
- generative-ai-application-builder-on-aws is open source under the Apache-2.0 license. Check the license terms before using it in commercial products.
- Is generative-ai-application-builder-on-aws still maintained?
- Actively maintained. The last commit to generative-ai-application-builder-on-aws was on Oct 6, 2026.
- What can I use generative-ai-application-builder-on-aws for?
- Piloting an internal chatbot that answers questions over company documents on AWS Comparing several foundation models on the same use case before choosing one for production Giving non-engineering teams a managed interface to launch and configure AI assistants Building a custom front end or integration on top of the provided chat API
- How do I install generative-ai-application-builder-on-aws?
- Install prerequisites (Docker, Node.js 20.x, CDK v2.118.0, Python 3.13.x, AWS CLI, jq) Configure AWS CLI credentials, then bootstrap CDK in your account and region if not already done: cdk bootstrap Deploy the solution with CDK: cdk deploy
- Where can I get generative-ai-application-builder-on-aws?
- The source code and installation instructions are on GitHub: https://github.com/aws-solutions/generative-ai-application-builder-on-aws
Summary generated by AI from the project's README. GitHub stats refresh daily.
Related projects
Static analysis tool that scans infrastructure as code, container images and open source packages for cloud misconfigurations and CVEs.
A Python library that constrains LLM outputs during generation so they match a given type, regex, JSON schema, or grammar.
Open-source RAG engine that pairs retrieval-augmented generation with agent capabilities to provide a context layer for LLM applications.
A lightweight knowledge-graph RAG framework and server that indexes documents into entities and relations for retrieval-augmented LLM answers.
Open-source Python framework for building production-ready LLM applications with modular pipelines and agent workflows for RAG, search and agents.