Open source inference engine that tunes its kernels to your hardware to run each open model as fast as possible.
7.1K491RustApache-2.0Updated yesterday
1 alternative
Looking for a free, open-source alternative to Ollama? These 1 projects can replace it. Each one is reviewed by a human and explained in plain words, so you can compare stars, license and maintenance at a glance.
| Project | Stars | License | Last commit |
|---|---|---|---|
| magnitudedev/magnitude | ★ 7.1K | Apache-2.0 | yesterday |
Open source inference engine that tunes its kernels to your hardware to run each open model as fast as possible.