Open-source projects tagged “pytorch”

Open-source interactive game video generation model that turns a reference image and keyboard or mouse inputs into controllable gameplay-style video.

A unified training engine for multimodal models, supporting VLM, diffusion and LLM training with FSDP2, Muon and Liger kernels.

A video LLM trained with streaming speech transcription that produces real-time commentary on live video, from the CVPR 2025 LiveCC paper.

Research code for WorldGrow, a method that generates open-ended, walkable 3D worlds block by block from a seed block, outputting Gaussian splats and meshes.

Python tool for blind face restoration, enhancing blurry, low-quality or damaged faces in photos and videos using a codebook lookup transformer.

A short introductory book on reinforcement learning, from basics to applied algorithms, with PyTorch implementations in the repo.