Microsoft Debuts Generative AI That Can Create Video-Game Scenes

Trained on Xbox data, the New Muse model could be a potential boon for game studios looking to cut costs.

Microsoft’s Xbox team and other industry players are eager to use AI to help reduce the hundreds of millions of dollars studios typically spend on blockbusters.

Photographer: Alex Kraus/Bloomberg
Lock
This article is for subscribers only.

Microsoft Corp. unveiled artificial intelligence tools that can create video-game scenes that would normally have to be programmed and animated by a human, a model it built using data collected from Xbox gamers and their controllers.

Called Muse, the model is the first of its kind, according to Microsoft. A machine learning research team surveyed game developers to discern how generative AI could be helpful and what they’d need for such tools to be effective, said Katja Hofmann, a senior principal research manager at Microsoft. Then, to train the AI model, Hofmann’s team collected seven years’ worth of gameplay data from Bleeding Edge, a 2020 multiplayer battle game from Xbox’s Ninja Theory studio.