Training recipes and scripts for continued pretraining and aligning language models with human or AI preferences using SFT, DPO, and ORPO.
5.7K496PythonApache-2.0Updated 29 days ago
#preference-alignment
Open-source projects tagged “preference-alignment”
Curated GitHub repositories related to preference-alignment, with AI summaries and key stats.