Open-source projects tagged “cpu-inference”

A llama.cpp fork focused on CPU inference speed, with extra quantization types and features for running GGUF LLMs locally.

Open-source text-to-speech library whose KittenTTS 2 model clones voices from 5 seconds of audio and runs in real time on a CPU.

A 0.1B-parameter multilingual text-to-speech model that runs in realtime on CPU, with voice cloning and 48 kHz stereo output.

Official CPU/GPU inference framework from Microsoft for 1-bit (ternary, 1.58-bit) large language models, built on llama.cpp.