Self-hosted inference server that serves embedding, reranking, extraction, OCR, guardrail, and LLM models from one cluster in your own cloud.
3.4K322PythonApache-2.0Updated 6 hours ago
#inference-server
Open-source projects tagged “inference-server”
Curated GitHub repositories related to inference-server, with AI summaries and key stats.