A launcher and patched llama.cpp setup that runs the 1.58-bit Ternary Bonsai 2 27B model with a 262k context on 12 GB and 8 GB NVIDIA GPUs.
826PythonOtherUpdated 19 hours ago
#rtx-4070
Open-source projects tagged “rtx-4070”
Curated GitHub repositories related to rtx-4070, with AI summaries and key stats.