You've been logged out of GDC Vault since the maximum users allowed for this account has been reached. To access Members Only content on GDC Vault, please log out of GDC Vault from the computer which last accessed this account.

Click here to find out about GDC Vault Membership options for more users.


The Number One Educational Resource for the Game Industry

Session Name: AI Summit: 'Age of Empires IV': Machine Learning Trials and Tribulations
Speaker(s): Guy Leroy, Sam Devlin, Peter Chan, Andrea Schiel
Company Name(s): Microsoft, Microsoft, Relic Entertainment, Microsoft
Track / Format: AI Summit

Did you know free users get access to 30% of content from the last 2 years?

Get your team full access to the most up to date GDC content

Overview: Machine Learning is a powerful technique now in use within games but it is not always apparent about when to apply it or at what level to apply it. Age of Empires IV, the latest instalment in the long running RTS franchise, is a very AI intensive game and an obvious candidate for ML application. We will cover some of the ML techniques, including Reinforcement Learning, used in AoE IV but with specific focus on what worked, and why some didn't. We'll also cover some of the ongoing research and early results. We'll cover training techniques, how to choose between the vast array of ML tools, and what we did to optimize the (runtime) inference. We highlight the technical challenges involved in integrating cutting edge RL research into a modern AAA game. This talk will be a joint presentation between Microsoft ML researchers and the AI developers that worked on AoE IV.

Game Developers Conference 2022

Guy Leroy


Sam Devlin


Peter Chan

Relic Entertainment

Andrea Schiel


free content

AI Summit