A launcher and patched llama.cpp setup that runs the 1.58-bit Ternary Bonsai 2 27B model with a 262k context on 12 GB and 8 GB NVIDIA GPUs.
826PythonOtherUpdated 18 hours ago
#bonsai
Open-source projects tagged “bonsai”
Curated GitHub repositories related to bonsai, with AI summaries and key stats.