EvolvingLMMs-Lab/lmms-engine

主な機能

• 01Distributed training with FSDP2, tensor parallelism, Ulysses sequence parallelism, and expert parallelism for MoE models.
• 02Sequence packing with first-fit bin packing and unpadded Flash Attention.
• 03Liger Triton kernels for fused CrossEntropy, RMSNorm, RoPE, and SwiGLU.
• 04Muon optimizer with Newton-Schulz orthogonalization, combined with Adam for other parameters.
• 05YAML-driven training configs launched via torchrun, Accelerate, or single GPU.
• 06Extensible registries for models, datasets, and processors.

ユースケース

• Vision-language pretraining or supervised fine-tuning of Qwen-VL style models on large multimodal datasets.
• Training Mixture-of-Experts multimodal models with expert parallelism across GPUs.
• Experimenting with diffusion or flow-matching video and image generation models such as WanVideo or SiT.
• Pretraining language models with the Muon optimizer and streaming datasets.

トピック

よくある質問

lmms-engine とは？

A unified training engine for multimodal models, supporting vision-language, diffusion, and MoE architectures with FSDP2, Muon, and Liger kernels.

lmms-engine は無料で使えますか？ライセンスは？

lmms-engine にはライセンスが明記されていません。コードは公開されていますが、ライセンスがない場合は再利用の許諾がないため、利用前に作者に確認することをおすすめします。

lmms-engine は今もメンテナンスされていますか？

活発にメンテナンス中。lmms-engine の最終コミットは 2026年10月18日 です。

lmms-engine は何に使えますか？

Vision-language pretraining or supervised fine-tuning of Qwen-VL style models on large multimodal datasets. Training Mixture-of-Experts multimodal models with expert parallelism across GPUs. Experimenting with diffusion or flow-matching video and image generation models such as WanVideo or SiT. Pretraining language models with the Muon optimizer and streaming datasets.

lmms-engine はどこで入手できますか？

ソースコードとインストール手順は GitHub にあります：https://github.com/EvolvingLMMs-Lab/lmms-engine