Open-source projects tagged “openvino”

A C++ inference server that serves OpenVINO-optimized generative AI and classic deep learning models over OpenAI-compatible and KServe APIs.

A Python framework for compressing neural networks via quantization, pruning and sparsity to speed up inference in OpenVINO, PyTorch and ONNX.