Python library that runs large language models layer by layer so 70B-class models can infer on a single 4GB GPU, without quantization.
39.5K4KJupyter NotebookApache-2.0Updated yesterday
#chinese-llm
Open-source projects tagged “chinese-llm”
Curated GitHub repositories related to chinese-llm, with AI summaries and key stats.