Open-source projects tagged “openai-api”

Runs the 125B-parameter Qwen3.8-Flash-Next model on a consumer NVIDIA or AMD GPU PC, exposing OpenAI- and Anthropic-compatible APIs on localhost.

Python library that detects LLM decoding corruption such as repetition loops and language drift mid-stream, so bad tokens can be cut before users see them.