Repolode
Submit
Azure-Samples

Azure-Samples/ai-hub-gateway-solution-accelerator

Azure solution accelerator for a central AI API gateway built on Azure API Management, governing and observing LLM access across teams.

View on GitHub
Stars
325
Forks
214
Open issues
10
Last commit
11 days ago

What is it?

Citadel Governance Hub is an enterprise AI landing zone that provides a central gateway for consuming AI models and services across business units on Azure. It is built on Azure API Management and deployed with Bicep or Terraform, with usage ingestion through Logic Apps, Event Hub and Cosmos DB, plus Jupyter notebooks for post-deployment validation.

The gateway applies runtime policies such as access control, token rate limiting, content safety, and PII detection, and routes requests to backends including Microsoft Foundry and Azure OpenAI, with load balancing and failover across backends serving the same model. Governance is declared as version-controlled contracts: backend contracts define which models the gateway can reach, and access contracts define which use cases can consume them under which policies.

The project is part of a layered reference architecture for AI security and compliance on Azure, and it includes guides covering networking, observability, Power BI cost dashboards and gateway upgrades.

Key features

  • 01Central Azure API Management gateway for routing LLM requests across backends
  • 02Load balancing and failover across backends serving the same model
  • 03Token rate limiting, content safety and PII detection policies
  • 04Contract-driven onboarding of backends, use cases and published tools or agents
  • 05Usage ingestion via Logic Apps, Event Hub and Cosmos DB with Power BI dashboards
  • 06Bicep and Terraform deployment with Azure Developer CLI

Use cases

  • Giving several business units governed access to shared Azure OpenAI or Foundry models
  • Tracking token usage and cost allocation per team or use case
  • Enforcing content safety and PII handling on LLM traffic in an enterprise landing zone
  • Onboarding existing agents to a central gateway using per-agent credentials

Things to know

  • Requires an Azure subscription and depends on several Azure services, including API Management, Event Hub, Cosmos DB, Logic Apps and Microsoft Foundry.
  • Deployment is a sizeable enterprise landing-zone setup, not a quick local install.
  • Publish Contracts and Foundry-hosted A2A publishing are in Preview.

In collections

Microservice frameworks & service infrastructure

Topics

#azure#api-gateway#llm#governance#azure-api-management#infrastructure-as-code#bicep#terraform

FAQ

What is ai-hub-gateway-solution-accelerator?
Azure solution accelerator for a central AI API gateway built on Azure API Management, governing and observing LLM access across teams. Citadel Governance Hub is an enterprise AI landing zone that provides a central gateway for consuming AI models and services across business units on Azure. It is built on Azure API Management and deployed with Bicep or Terraform, with usage ingestion through Logic Apps, Event Hub and Cosmos DB, plus Jupyter notebooks for post-deployment validation.
Is ai-hub-gateway-solution-accelerator free to use? What license does it have?
ai-hub-gateway-solution-accelerator is open source under the MIT license. Check the license terms before using it in commercial products.
Is ai-hub-gateway-solution-accelerator still maintained?
Actively maintained. The last commit to ai-hub-gateway-solution-accelerator was on Oct 27, 2026.
What can I use ai-hub-gateway-solution-accelerator for?
Giving several business units governed access to shared Azure OpenAI or Foundry models Tracking token usage and cost allocation per team or use case Enforcing content safety and PII handling on LLM traffic in an enterprise landing zone Onboarding existing agents to a central gateway using per-agent credentials
Where can I get ai-hub-gateway-solution-accelerator?
The source code and installation instructions are on GitHub: https://github.com/Azure-Samples/ai-hub-gateway-solution-accelerator

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects