Open-source projects tagged “model-serving”

A serving framework that extends vLLM to run omni-modality models producing text, image, audio, video and action outputs.

A Kubernetes-native platform for deploying and serving predictive and generative AI models at scale, across multiple ML frameworks.