GPU-optimized library and reference training scripts for training large transformer models with multi-dimensional parallelism.
18.2K4.6KPythonOtherUpdated 11 hours ago
#model-para
Curated GitHub repositories related to model-para, with AI summaries and key stats.
GPU-optimized library and reference training scripts for training large transformer models with multi-dimensional parallelism.