ViZDoom swMATH ID: 38437 Software Authors: Michał Kempka, Marek Wydmuch, Grzegorz Runc, Jakub Toczek, Wojciech Jaśkowski Description: ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning. The recent advances in deep neural networks have led to effective vision-based reinforcement learning methods that have been employed to obtain human-level controllers in Atari 2600 games from pixel data. Atari 2600 games, however, do not resemble real-world tasks since they involve non-realistic 2D environments and the third-person perspective. Here, we propose a novel test-bed platform for reinforcement learning research from raw visual information which employs the first-person perspective in a semi-realistic 3D world. The software, called ViZDoom, is based on the classical first-person shooter video game, Doom. It allows developing bots that play the game using the screen buffer. ViZDoom is lightweight, fast, and highly customizable via a convenient mechanism of user scenarios. In the experimental part, we test the environment by trying to learn bots for two scenarios: a basic move-and-shoot task and a more complex maze-navigation problem. Using convolutional deep neural networks with Q-learning and experience replay, for both scenarios, we were able to train competent bots, which exhibit human-like behaviors. The results confirm the utility of ViZDoom as an AI research platform and imply that visual reinforcement learning in 3D realistic first-person perspective environments is feasible. Homepage: https://arxiv.org/abs/1605.02097 Source Code: https://github.com/mwydmuch/ViZDoom Keywords: Machine Learning; arXiv_cs.LG; Artificial Intelligence; arXiv_cs.AI; Computer Vision; Pattern Recognition; arXiv_cs.CV Related Software: AI2-THOR; Adam; MuJoCo; BabyWalk; CHALET; SAPIEN; AllenAct; Habitat; TorchCraft; ALFRED; MINOS; SQIL; VirtualHome; TEACh; EvolveGraph; HRL4IN; iGibson; ArraMon; ViLBERT; LXMERT Cited in: 3 Publications all top 5 Cited by 10 Authors 1 Fachantidis, Anestis 1 Francis, Jonathan 1 Kitamura, Nariaki 1 Labelle, Felix 1 Lazaridis, Aristotelis 1 Lu, Xiaopeng 1 Navarro, Ingrid 1 Oh, Jean 1 Ueltzhöffer, Kai 1 Vlahavas, Ioannis P. Cited in 2 Serials 2 The Journal of Artificial Intelligence Research (JAIR) 1 Biological Cybernetics Cited in 2 Fields 3 Computer science (68-XX) 1 Biology and other natural sciences (92-XX) Citations by Year