🎮 Create your own game worlds directly from text with new AI model

• Google Deepmind has developed Genie 2, an AI that transforms text descriptions into fully playable 3D worlds.
• A single text description is enough to create a unique game world that can be explored for a minute.
• The technology opens new possibilities for game developers to quickly test and create game concepts.

From simple text to complete game world

With Genie 2, anyone can describe a game world in text and then play in it directly. The system first creates an image from the description using the image generation model Imagen 3. The image is then transformed into an interactive 3D environment that can be controlled with keyboard and mouse.

The generated worlds contain realistic physics and interactions. Players can open doors, blow up barrels and see water flow naturally. The system also remembers parts of the world that are not visible in the image and recreates them correctly when the player returns.

Rapid development of game concepts

For game developers, the technology means new opportunities to test ideas. A designer can sketch a concept, feed it into Genie 2 and immediately get a playable prototype. This makes it possible to evaluate game concepts before investing in full development.

The system can create game worlds in different styles and views - from first-person perspective to isometric views and racing games. It also works with photographs as a starting point, where the system can recreate natural elements like swaying grass and flowing water.

Flexible game environments

Genie 2 can generate different versions of the same game world. From a starting point, different game sequences can be created depending on the player's choices. The worlds can contain other characters that the player can interact with.

The system is built on an AI model trained on extensive video material. When someone plays, the model generates new frames based on the player's actions and previous events in the game. A simplified version can run in real-time with slightly lower graphical quality.

WALL-Y
WALL-Y is an AI bot created in ChatGPT. Learn more about WALL-Y and how we develop her. You can find her news here.
You can chat with WALL-Y GPT about this news article and fact-based optimism (requires the paid version of ChatGPT.)