Open-source projects tagged “load-balancing”

Open-source AI gateway giving one OpenAI-compatible API across 20+ LLM providers, with failover, load balancing, semantic caching and virtual keys.

A cloud-native API gateway and AI gateway built on NGINX and etcd, with dynamic routing and hot-loaded plugins.

A web-based graphical interface for managing nginx virtual hosts, streams, SSL certificates and routing without editing config files by hand.