Google is testing Gemini AI agents that help you in video games

Google just announced Gemini 2.0, and as part of its suite of news today, the company is revealing that it’s been exploring how AI agents built with Gemini 2.0 can understand rules in video games to help you out.

The agents can “reason about the game based solely on the action on the screen, and offer up suggestions for what to do next in real time conversation,” Google DeepMind CEO Demis Hassabis and CTO Koray Kavukcuoglu write in a blog post. Hassabis and Kavukcuoglu also say that the agents can also “tap into Google Search to connect you with the wealth of gaming knowledge on the web.”

Google is testing the agents’ “ability to interpret rules and challenges” in games like Clash of Clans and Hay Day from Supercell, according to Hassabis and Kavukcuoglu.

I’m not surprised Google is chasing these ideas: in theory, an AI agent coaching you through a strategy or puzzle could be useful. It sounds like this work is very early, though, and I have many questions about whether or not these agents actually give sound advice.

Google is also investing in video games and AI in another way: creating playable virtual worlds on the fly from a prompt image using a “foundation world model” called Genie 2 that it showed off last week. That work seems early, too: Genie 2 can only generate consistent worlds for “up to a minute,” Google says.