The Optimal Observability of Partially Observable Markov Decision Processes: Discrete State Space
Access Status
Fulltext not available
Authors
Rezaeian, M.
Vo, Ba-Ngu
Evans, J.
Date
2010Type
Journal Article
Metadata
Show full item recordCitation
Rezaeian, M. and Vo, B. and Evans, J. 2010. The Optimal Observability of Partially Observable Markov Decision Processes: Discrete State Space. IEEE Transactions on Electromagnetic Compatibility. 55 (12): pp. 2793-2798.
Source Title
IEEE Transactions on Electromagnetic Compatibility
ISSN
Collection
Abstract
We consider autonomous partially observable Markov decision processes where the control action influences the observation process only. Considering entropy as the cost incurred by the Markov information state process, the optimal observability problem is posed as a Markov decision scheduling problem that minimizes the infinite horizon cost. This scheduling problem is shown to be equivalent to minimization of an entropy measure, called estimation entropy which is related to the invariant measure of the information state.
Related items
Showing items related by title, author, creator and subject.
-
Xia, Jianhong (Cecilia); Zeephongsekul, P. (2009)Tourist movement is a complex process, but it provides very useful information for park managers and tourist operators. This paper aims to establish a sound methodology for modelling the spatial and temporal movement of ...
-
Duong, Thi V. T. (2008)Modeling patterns in temporal data has arisen as an important problem in engineering and science. This has led to the popularity of several dynamic models, in particular the renowned hidden Markov model (HMM) [Rabiner, ...
-
Nguyen, Hoa ; Rezatofighi, H.; Vo, Ba-Ngu ; Ranasinghe, D.C. (2019)We consider the problem of online path planning for joint detection and tracking of multiple unknown radio-tagged objects. This is a necessary task for gathering spatio-temporal information using UAVs with on-board sensors ...