Open-source AI gateway giving one OpenAI-compatible API across 23+ LLM providers, with failover, load balancing, semantic caching and virtual keys.
8.9K1.4KGoApache-2.0Updated 1 hour ago
#llm-observability
Curated GitHub repositories related to llm-observability, with AI summaries and key stats.
Open-source AI gateway giving one OpenAI-compatible API across 23+ LLM providers, with failover, load balancing, semantic caching and virtual keys.