A PyTorch-based distributed training and inference system for large AI models, offering parallelism, memory optimization and heterogeneous training.
AI & Machine Learning#deep-learning#distributed-training#model-parallelism#pipeline-parallelism#pytorch
41.4K4.5KPythonApache-2.0Updated 8 hours ago