Self-hosted, source-available LLM router that sends simple prompts to cheap or local models and complex ones to premium models, behind an OpenAI-compatible proxy.
66180PythonOtherUpdated 6 hours ago
#ai-cost-reduction
Curated GitHub repositories related to ai-cost-reduction, with AI summaries and key stats.
Self-hosted, source-available LLM router that sends simple prompts to cheap or local models and complex ones to premium models, behind an OpenAI-compatible proxy.