Visual Attention Assisted Games

Mandal, Bappaditya; Puhan, Niladri B.; Homi Anil, Varma

Abstract

In this work, we propose a committee of attention models developed for improving the deep reinforcement learning frequently used for games. The game environment is manifested with spatial and temporal attention mechanisms so as to focus on important regions while playing the games. We propose that when an agent’s visual attention space is streamlined and strategic temporally coherent representations are used, generalisation will be faster than other traditional architectures. The proposed spatial attention mechanism’s output enables direct analysis of the information recognised by the agent to choose its actions, allowing for a more straightforward interpretation of the provided state. We evaluate several techniques across a variety of games to reinforce our argument. Extensive experimental results on five Atari 2600 games demonstrate that an agent that makes use of this framework is capable of outperforming state-of-the-art models on ATARI tasks while being interpretable.

Citation

Mandal, B., Puhan, N. B., & Homi Anil, V. (2023). Visual Attention Assisted Games. In 2023 IEEE Conference on Games (CoG). https://doi.org/10.1109/cog57401.2023.10333186

• Conference Name: IEEE Symposium on Computational Intelligence and Games, CIG
• Conference Location: Boston, MA, USA
• Start Date: Aug 21, 2023
• End Date: Aug 24, 2023
• Acceptance Date: Aug 21, 2023
• Online Publication Date: Dec 4, 2023
• Publication Date: Aug 21, 2023
• Deposit Date: Jan 8, 2024
• Book Title: 2023 IEEE Conference on Games (CoG)
• ISBN: 979-8-3503-2278-1
• DOI: https://doi.org/10.1109/cog57401.2023.10333186
• Publisher URL: https://ieeexplore.ieee.org/document/10333186
• Related Public URLs: https://ieeexplore.ieee.org/xpl/conhome/10333091/proceeding