GDC Vault is part of the Informa Tech Division of Informa PLC
This is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.
Imitation Learning: Building Practical Agents to Test and Explore a First-Person Shooter
The talk introduces style-centric autoplay agents that game developers can train quickly and on a budget to facilitate testing and evaluating the gameplay of a title under development. The focus on the practical and stylistic aspects suggests a simple approach based on the Markov model. Markov agents are trainable interactively and can incorporate new game features without re-training the entire model. While such agents efficiently capture the demonstrated gameplay style, they may require fallback heuristics to address possible lack of performance, or the game states not explicitly present in organic play-throughs. Imitation learning on the data bootstrapped from the enhanced with heuristics Markov agent allows training of a compact computationally efficient DNN model suitable for automated game evaluation and testing. A generic First-Person Shooter game example provides a practical context for the presentation. The GitHub repository illustrates Markov agents in more detail and uses OpenAI gym environments for an interactive demo.
Did you know free users get access to 30% of content from the last 2 years?