An unofficial Rust client library for the OpenAI API, also usable with OpenRouter endpoints.
48593RustMITUpdated last month
#chat-completion
Best open-source chat completion client libraries (2026)
These libraries give a program one API for chat completions across model providers, hiding the differences between their request formats. When picking one, check that it matches your language and the providers you need, and whether you need streaming or tool calling. rust-genai uses each provider's native protocol, which suits Rust projects that talk to several models. ollama4j wraps the REST API of a local Ollama server, including chat, embeddings and model management. ai-dial-core is a Java HTTP proxy that puts multiple models, assistants and applications behind one endpoint.
Sort:Recently added
6 repositories
Async Scala client for the OpenAI API and many other LLM providers, covering chat, responses, streaming, batches, and more.
25740ScalaMITWell maintainedUpdated yesterday
A unified Ruby API for chat, speech, and embeddings across multiple AI providers such as OpenAI, Anthropic, Google, Mistral, and DeepSeek.
25415RubyMITWell maintainedUpdated 8 days ago
A Rust library giving one common API for chatting with many AI providers using each provider's native protocol.
937+14 this week198RustApache-2.0Well maintainedUpdated 3 days ago
Java-based HTTP proxy that gives a single unified API over multiple chat completion and embedding models, assistants and applications.
66244JavaApache-2.0Updated yesterday
A Java library for calling the Ollama server's REST API, covering chat, generation, tools, embeddings and model management.
509+3 this week85JavaMITUpdated 13 days ago