Improved Reinforcement Learning in Asymmetric Real-time Strategy Games via Strategy Diversity
-
Published:2023-03-31
Issue:1
Volume:10
Page:19-38
-
ISSN:2384-8766
-
Container-title:International Journal of Serious Games
-
language:
-
Short-container-title:IJSG
Author:
Dasgupta Raj,Kliem John
Abstract
We investigate the use of artificial intelligence (AI)-based techniques in learning to play a 2-player, real-time strategy (RTS) game called Hunting-of-the-Plark. The game is challenging to play for both humans and AI-based techniques because players cannot observe each other's moves while playing the game and one player is at a disadvantage due to the asymmetric nature of the game rules. We analyze the performance of different deep reinforcement learning algorithms to train software agents that can play the game. Existing reinforcement learning techniques for RTS games enable players to converge towards an equilibrium outcome of the game but usually do not facilitate further exploration of techniques to exploit and defeat the opponent. To address this shortcoming, we investigate techniques including self-play and strategy diversity that can be used by players to improve their performance beyond the equilibrium outcome. We observe that when players use self-play, their number of wins begins to cycle around an equilibrium value as each player quickly learns to outwit and defeat its opponent and vice-versa. Finally, we show that strategy diversity could be used as an effective means to alleviate the performance of the disadvantaged player caused by the asymmetric nature of the game.
Publisher
Serious Games Society
Subject
Applied Mathematics,Artificial Intelligence,Computer Graphics and Computer-Aided Design,Human-Computer Interaction,Education,Software
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Editorial Vol. 10, Issue 1.;International Journal of Serious Games;2023-03-31