×

POMDPS

swMATH ID: 3055
Software Authors: Ross, S.; Pineau, J.; Paquet, S.; Chaib-Draa, B.
Description: Online planning algorithms for POMDPS. Partially Observable Markov Decision Processes (POMDPs) provide a rich framework for sequential decision-making under uncertainty in stochastic domains. However, solving a POMDP is often intractable except for small problems due to their complexity. Here, we focus on online approaches that alleviate the computational complexity by computing good local policies at each decision step during the execution. Online algorithms generally consist of a lookahead search to find the best action to execute at each time step in an environment. Our objectives here are to survey the various existing online POMDP methods, analyze their properties and discuss their advantages and disadvantages; and to thoroughly evaluate these online approaches in different environments under various metrics (return, error bound reduction, lower bound improvement). Our experimental results indicate that state-of-the-art online heuristic search methods can handle large POMDP domains efficiently
Homepage: http://www.pomdp.org/pomdp/index.shtml
Keywords: Partially Observable Markov Decision Processes; online algorithms
Related Software: DESPOT; EGO; PRMLT; Clingo; Anglican; ProbLog; GOLOG; CARLA; AdaGrad; Adam; Approxrl; ElemStatLearn; ROME; COMPASS; itsmr; BayesDA; R-MAX; MCQueue; UCPOP; Graphplan
Cited in: 38 Publications
Further Publications: http://www.pomdp.org/pomdp/papers/index.shtml

Standard Articles

1 Publication describing the Software, including 1 Publication in zbMATH Year
Online planning algorithms for POMDPS. Zbl 1182.68265
Ross, S.; Pineau, J.; Paquet, S.; Chaib-Draa, B.
2008
all top 5

Cited by 78 Authors

6 Goulionis, John E.
2 Benos, V. K.
2 Brunskill, Emma
2 Chong, Edwin Kah Pin
2 Hutter, Marcus
2 Kaelbling, Leslie Pack
2 Krishnamurthy, Vikram
2 Littman, Michael L.
2 Oliehoek, Frans A.
2 Pajarinen, Joni
2 Peters, Jan
2 Powell, Warren Buckler
2 Roy, Nicholas
2 Stengos, Dimitrios I.
2 Tzavelas, George
2 Vlassis, Nikos
1 Ahuja, Vishal
1 Akrour, Riad
1 Amato, Christopher
1 Aras, R.
1 Bai, Haoyu
1 Bernstein, Daniel S.
1 Bikakis, Antonis
1 Birge, John R.
1 Cassandra, Anthony R.
1 Çelik, Melih
1 Chaib-draa, Brahim
1 Chang, Fangfang
1 Chatterjee, Krishnendu
1 D’Asaro, Fabio Aurelio
1 Dickens, Luke
1 Doshi, Prashant
1 Doyen, Laurent
1 Dutech, A.
1 Ergun, Ozlem
1 Förster, Alexander
1 Fu, Qiming
1 Gmytrasiewicz, Piotr J.
1 Han, Weidong
1 Harris, Zachary A.
1 Henzinger, Thomas A.
1 Hero, Alfred O. III
1 Hsu, David Y.
1 Keskinocak, Pinar
1 Kooij, Julian F. P.
1 Kreucher, Christopher M.
1 Kyrki, Ville
1 Lauri, Mikko
1 Lee, Wee Sun
1 Liu, Quan
1 Liu, Yunlong
1 Lozano-Pérez, Tomás
1 Miller, Rob
1 Miller, Scott A.
1 Neumann, Gerhard
1 Ng, Kee Siong
1 Ngo, Vien A.
1 O’Kane, Jason M.
1 Paquet, Sébastien
1 Pineau, Joelle
1 Rahmani, Hazhar
1 Ritala, Risto
1 Ross, Stéphane
1 Schmidhuber, Jürgen
1 Shell, Dylan A.
1 Silver, David M.
1 Spaan, Matthijs T. J.
1 Stengos, D. J.
1 Thai, Hong Linh
1 Uther, William T. B.
1 Veness, Joel
1 Wahlberg, Bo
1 Wierstra, Daan
1 Zeng, Guangzhou
1 Zhang, Xiaofang
1 Zhang, Zongzhang
1 Zheng, Jianyang
1 Zilberstein, Shlomo
all top 5

Cited in 22 Serials

8 The Journal of Artificial Intelligence Research (JAIR)
3 Artificial Intelligence
2 Operations Research
2 Annals of Mathematics and Artificial Intelligence
2 JP Journal of Biostatistics
1 Journal of Mathematical Psychology
1 Mathematics of Operations Research
1 International Journal of Approximate Reasoning
1 Machine Learning
1 JETAI. Journal of Experimental & Theoretical Artificial Intelligence
1 Discrete Event Dynamic Systems
1 European Journal of Operational Research
1 INFORMS Journal on Computing
1 Informatica (Ljubljana)
1 Logic Journal of the IGPL
1 Journal of Statistics & Management Systems
1 Advances and Applications in Statistics
1 EURASIP Journal on Advances in Signal Processing
1 Far East Journal of Mathematical Education
1 Algorithms
1 Journal of Informatics and Mathematical Sciences
1 Frontiers of Computer Science
all top 5

Cited in 8 Fields

23 Computer science (68-XX)
20 Operations research, mathematical programming (90-XX)
2 Statistics (62-XX)
2 Numerical analysis (65-XX)
2 Biology and other natural sciences (92-XX)
2 Systems theory; control (93-XX)
1 Mathematical logic and foundations (03-XX)
1 Probability theory and stochastic processes (60-XX)

Citations by Year