POMDP swMATH ID: 3204 Software Authors: Cassandra, Anthony R. Description: Partially Observable Markov Decision Process (POMDP). The ’pomdp-solve’ program solves problems that are formulated as partially observable Markov decision processes, a.k.a. POMDPs. It uses the basic dynamic programming approach for all algorithms, solving one stage at a time working backwards in time. It does finite horizon problems with or without discounting. It will stop solving if the answer is within a tolerable range of the infinite horizon answer, and there are a couple of different stopping conditions (requires a discount factor less than 1.0). Alternatively you can solve a finite horizon problem for some fixed horizon length. The code actually implements a number of POMDP solution algorithms Homepage: http://www.pomdp.org/pomdp/code/index.shtml Related Software: PRISM; Storm; Adam; Jani; z3; RMSprop; GitHub; ZMDP; Graphviz; Reluplex; Safety Gym; QT-Opt; IMPALA; Horizon; TEXPLORE; Alpaga Cited in: 26 Publications Further Publications: http://www.pomdp.org/pomdp/papers/index.shtml all top 5 Cited by 65 Authors 3 Junges, Sebastian 2 Chatterjee, Krishnendu 2 Chmelík, Martin 2 Jansen, Nils 2 Katoen, Joost-Pieter 2 Norman, Gethin 2 Zou, Xueyi 1 Ayer, Turgay 1 Baier, Christel 1 Belle, Vaishak 1 Bernstein, Daniel S. 1 Bertrand, Nathalie 1 Busemeyer, Jerome R. 1 Carr, Steven 1 Češka, Milan 1 Diéguez, Amador R. 1 Dulac-Arnold, Gabriel 1 Fernández, Joaquín L. 1 Givan, Robert L. 1 Goldsmith, Judy 1 Gordon, Geoff 1 Gouberman, Alexander 1 Gowal, Sven 1 Größer, Marcus 1 Guerreiro, Sérgio Luís Proença Duarte 1 Heck, Linus 1 Hensel, Christian 1 Hester, Todd 1 Immerman, Neil 1 Jiang, Ruiwei 1 Kim, Donggun 1 Kıvanç, İpek 1 Lee, Gilwon 1 Levine, Nir 1 Li, Jerry 1 Li, Yanjie 1 Lusena, Christopher 1 Mankowitz, Daniel J. 1 Moerman, Joshua 1 Mundhenk, Martin 1 Nakao, Hideaki 1 Özgür-Ünlüakın, Demet 1 Paduraru, Cosmin 1 Pleskac, Timothy J. 1 Roy, Nicholas 1 Sanz, Rafael 1 Seo, Junyeong 1 Seshia, Sanjit Arunkumar 1 Shen, Siqian 1 Siegle, Markus 1 Simmons, Reid G. 1 Spaan, Matthijs T. J. 1 Spel, Jip 1 Sung, Youngchul 1 Thrun, Sebastian 1 Topcu, Ufuk 1 Tracol, Mathieu 1 Treszkai, Laszlo 1 Vlassis, Nikos 1 Xi, Hongsheng 1 Yin, Baoqun 1 Zhang, Hao 1 Zhang, Nevin Lianwen 1 Zhang, Weihong 1 Zilberstein, Shlomo all top 5 Cited in 16 Serials 5 The Journal of Artificial Intelligence Research (JAIR) 1 Artificial Intelligence 1 Journal of Computer and System Sciences 1 Journal of Mathematical Psychology 1 Mathematics of Operations Research 1 Operations Research 1 International Journal of Approximate Reasoning 1 Formal Aspects of Computing 1 Annals of Operations Research 1 Real-Time Systems 1 Machine Learning 1 IEEE Transactions on Signal Processing 1 European Journal of Operational Research 1 SIAM Journal on Optimization 1 Journal of Heuristics 1 SN Operations Research Forum all top 5 Cited in 6 Fields 18 Computer science (68-XX) 13 Operations research, mathematical programming (90-XX) 3 Systems theory; control (93-XX) 2 Probability theory and stochastic processes (60-XX) 1 Mathematical logic and foundations (03-XX) 1 Information and communication theory, circuits (94-XX) Citations by Year