A TypeScript engine that runs LLM inference entirely in the browser using WebGPU, with an OpenAI-compatible API.
19.3K1.4KTypeScriptApache-2.0Updated 10 days ago
#in-browser
Curated GitHub repositories related to in-browser, with AI summaries and key stats.
A TypeScript engine that runs LLM inference entirely in the browser using WebGPU, with an OpenAI-compatible API.