Abstract
Abstract A partially observable Markov decision process (POMDP) is a generalization of a Markov decision process where the states of the model are not completely observable by the decision maker. Noisy observations provide a belief regarding the underlying state, while the decision maker has some control over the progression of the model through the selection of actions. In this article, we introduce POMDPs and discuss the relationship between Markov models and POMDPs. A general POMDP formulation and a wide range of POMDP applications from the literature are also presented.
Keywords
Partially observable Markov decision processMarkov decision processObservableComputer scienceGeneralizationDecision makerMarkov processRange (aeronautics)Process (computing)Mathematical optimizationArtificial intelligenceMarkov modelMarkov chainMachine learningOperations researchMathematics
Affiliated Institutions
Related Publications
Acting Optimally in Partially Observable Stochastic Domains
In this paper, we describe the partially observable Markov decision process (pomdp) approach to finding optimal or near-optimal control strategies for partially observable stoch...
Decentralized learning in finite Markov chains
The principal contribution of this paper is a new result on the decentralized control of finite Markov chains with unknown transition probabilities and rewords. One decentralize...
The optimal control of partially observable Markov processes
The report studies the control of a finite-state, discrete-time Markov process characterized by incomplete state observation. The process is viewed through a set of outputs such...
A Probabilistic Production and Inventory Problem
R. Howard (R. Howard.1960. Dynamic Programming and Markov Processes. John Wiley and Sons, Inc., New York.) and A. Manne (A. Manne. 1960. Linear programming and sequential decisi...
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Many of the complex problems faced by decision makers involve multiple conflicting objectives. This book describes how a confused decision maker, who wishes to make a reasonable...
Publication Info
- Year
- 2011
- Type
- other
- Citations
- 6
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
6
OpenAlex
Cite This
Emine Yaylalı,
Julie S. Ivy
(2011).
Partially Observable<scp>MDPs</scp>(<scp>POMDPS</scp>): Introduction and Examples.
Wiley Encyclopedia of Operations Research and Management Science
.
https://doi.org/10.1002/9780470400531.eorms0646
Identifiers
- DOI
- 10.1002/9780470400531.eorms0646