Open-source projects tagged “model-parallelism”

A deep learning optimization library for making distributed training and inference of large models easier and more efficient.

GPU-optimized library and reference training scripts for training large transformer models with multi-dimensional parallelism.