Open-source projects tagged “openai-compatible”

Open-source AI gateway giving one OpenAI-compatible API across 20+ LLM providers, with failover, load balancing, semantic caching and virtual keys.

A local model gateway that lets Claude Code, Codex, OpenCode and other coding agents share one endpoint and route requests across multiple model providers.

Self-hostable captcha solver exposing a YesCaptcha-style createTask/getTaskResult API, built on FastAPI, Playwright and OpenAI-compatible vision models.

A CLI and web dashboard that benchmarks free coding LLMs across many providers and installs the one you pick into your coding tool.

An edge-native MoE serving engine that runs large open-weight models like DeepSeek-V4 and Qwen3.6 on consumer GPUs by splitting work between GPU and CPU memory.

A local OpenAI-compatible bridge that lets opencode use the free DeepSeek web chat as a model provider, with no API key.

A pure C inference engine that runs very large mixture-of-experts models on ordinary hardware by streaming routed experts from disk.

An open-source agent runtime and terminal app for long-horizon research and file-based work, with ReAct and parallel Agent Team modes.

Self-hosted inference server that serves embedding, reranking, extraction, OCR, guardrail, and LLM models from one cluster in your own cloud.

Open source inference engine that tunes its kernels to your hardware to run each open model as fast as possible.

Local proxy that lets OpenAI Codex and Claude Code run on any LLM provider, including Claude, Gemini, Grok, DeepSeek, and Ollama.