A minimal C11 LLM inference engine that runs 1B-class LLaMA-architecture GGUF models on low-cost boards like Raspberry Pi with about 45MB of RAM.
2.2K286CMITUpdated 8 months ago
#arm
Curated GitHub repositories related to arm, with AI summaries and key stats.
A minimal C11 LLM inference engine that runs 1B-class LLaMA-architecture GGUF models on low-cost boards like Raspberry Pi with about 45MB of RAM.