Repolode
Submit
SkyworkAI

SkyworkAI/Matrix-Game

An open-source interactive world model from Skywork AI that renders playable game scenes frame by frame with a causal video model on top of an executable game engine.

View on GitHubWebsite
Stars
2,596
Forks
282
Open issues
42
Last commit
3 days ago

What is it?

Matrix-Game 4.0 is an interactive world model that separates game logic from visual rendering. The executable game engine keeps track of gameplay, physics and player input, while a causal video model turns low-poly RGB frames into detailed visuals in a streaming fashion, conditioned on text prompts.

The release includes three playable scenes: Medieval Castle and Ancient Egypt for third-person shooting, and City Racing for driving. Model weights and game assets are hosted on Hugging Face, and the code provides offline rendering and an online browser demo.

Inference is supported on single-GPU setups including A100, RTX 5090, RTX 5080 and RTX 5070 Ti, with optimized paths for the RTX cards using FP8 layers, fused kernels, CUDA graphs and an optional SageAttention backend.

Key features

  • 01Keeps gameplay logic and physics in an executable engine, separate from neural rendering.
  • 02Streams video in chunks with a causal, few-step model conditioned on low-poly RGB and text prompts.
  • 03Ships three playable scenes: Medieval Castle, Ancient Egypt and City Racing.
  • 04Provides offline rendering and an online browser demo.
  • 05Offers single-GPU inference paths for A100 and several RTX 50-series cards.

Use cases

  • Researching interactive world models and neural rendering for games.
  • Prototyping game visuals where a low-poly engine provides gameplay and a model adds detail.
  • Experimenting with real-time generated video conditioned on player input.

Topics

#world-model#video-generation#neural-rendering#game-ai#real-time#long-video#cuda#genie#interactive-video#long-horizon-memory

FAQ

What is Matrix-Game?
An open-source interactive world model from Skywork AI that renders playable game scenes frame by frame with a causal video model on top of an executable game engine. Matrix-Game 4.0 is an interactive world model that separates game logic from visual rendering. The executable game engine keeps track of gameplay, physics and player input, while a causal video model turns low-poly RGB frames into detailed visuals in a streaming fashion, conditioned on text prompts.
Is Matrix-Game free to use? What license does it have?
Matrix-Game is open source under the MIT license. Check the license terms before using it in commercial products.
Is Matrix-Game still maintained?
Actively maintained. The last commit to Matrix-Game was on Oct 16, 2026.
What can I use Matrix-Game for?
Researching interactive world models and neural rendering for games. Prototyping game visuals where a low-poly engine provides gameplay and a model adds detail. Experimenting with real-time generated video conditioned on player input.
Where can I get Matrix-Game?
The source code and installation instructions are on GitHub: https://github.com/SkyworkAI/Matrix-Game

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects