Open-source library for training large language models with 3D parallelism, ZeRO memory optimization and Hugging Face integration, built on PyTorch and Triton.
33753PythonOtherUpdated 6 days ago
#zero-optimizer
Open-source projects tagged “zero-optimizer”
Curated GitHub repositories related to zero-optimizer, with AI summaries and key stats.