Rust-based LLM inference engine serving OpenAI- and Anthropic-compatible APIs, with quantization, multimodal models, and agent tooling.
7.8K742RustMITUpdated yesterday
#uqff
Curated GitHub repositories related to uqff, with AI summaries and key stats.
Rust-based LLM inference engine serving OpenAI- and Anthropic-compatible APIs, with quantization, multimodal models, and agent tooling.