Engine-agnostic LLM gateway in Rust that routes OpenAI- and Anthropic-compatible traffic across self-hosted inference engines and cloud model providers.
633195RustApache-2.0Updated 14 hours ago
#inference-gateway
Open-source projects tagged “inference-gateway”
Curated GitHub repositories related to inference-gateway, with AI summaries and key stats.