Self-hostable MIT AI gateway that exposes one OpenAI-compatible endpoint to hundreds of model providers, with quota-aware auto-fallback and token compression.
78.3K11.4KTypeScriptMITUpdated 7 hours ago
#llm-routing
Open-source projects tagged “llm-routing”
Curated GitHub repositories related to llm-routing, with AI summaries and key stats.
Sort:Recently added
2 repositories
Self-hosted, OpenAI-compatible LLM gateway that routes one endpoint to 40+ providers with virtual keys, budgets, and usage tracking.
68789PythonApache-2.0Updated 5 hours ago