A from-scratch pretraining and SFT pipeline for a small Chinese LLaMA2-style model, runnable on a single 24G GPU.
2.9K354PythonMITUpdated 2 months ago
#sft
Curated GitHub repositories related to sft, with AI summaries and key stats.
A from-scratch pretraining and SFT pipeline for a small Chinese LLaMA2-style model, runnable on a single 24G GPU.