Open source inference engine that tunes its kernels to your hardware to run open models faster on Apple Silicon, NVIDIA, AMD, or CPU.
7.2K494RustApache-2.0Updated 2 days ago
#ollama-alternative
Curated GitHub repositories related to ollama-alternative, with AI summaries and key stats.
Open source inference engine that tunes its kernels to your hardware to run open models faster on Apple Silicon, NVIDIA, AMD, or CPU.