A machine learning compiler and deployment engine that runs large language models natively across GPUs, browsers, and mobile devices with OpenAI-compatible APIs.
23.3K2.2KPythonApache-2.0Updated 15 days ago
#machine-learning-compiler
Curated GitHub repositories related to machine-learning-compiler, with AI summaries and key stats.
A machine learning compiler and deployment engine that runs large language models natively across GPUs, browsers, and mobile devices with OpenAI-compatible APIs.