Optimal control of nonlinear Markov jump systems by control parametrisation technique
Citation
Source Title
ISSN
Faculty
School
Collection
Abstract
This paper considers an optimal control problem of nonlinear Markov jump systems with continuous state inequality constraints. Due to the presence of continuous-time Markov chain, no existing computation method is available to solve such an optimal control problem. In this paper, a derandomisation technique is introduced to transform the nonlinear Markov jump system into a deterministic system, which simultaneously gives rise to an equivalent deterministic dynamic optimisation problem. The control parametrisation technique is then used to partition the time horizon into a sequence of subintervals such that the control function is approximated by a piecewise constant function consistent with the partition. The heights of the piecewise constant function on the corresponding subintervals are taken as decision variables to be optimised. In this way, the approximate dynamic optimisation problem is an optimal parameter selection problem, which can be viewed as a finite dimensional optimisation problem. To solve it using a gradient-based optimisation method, the gradient formulas of the cost function and the constraint functions are derived. Finally, a real-world practical problem involving a bioreactor tank model is solved using the method proposed.
Related items
Showing items related by title, author, creator and subject.
-
Chai, Qinqin (2013)In this thesis, we develop new computational methods for three classes of dynamic optimization problems: (i) A parameter identification problem for a general nonlinear time-delay system; (ii) an optimal control problem ...
-
Loxton, Ryan Christopher (2010)In this thesis, we develop numerical methods for solving five nonstandard optimal control problems. The main idea of each method is to reformulate the optimal control problem as, or approximate it by, a nonlinear programming ...
-
Li, Bin (2011)In this thesis, we consider several types of optimal control problems with constraints on the state and control variables. These problems have many engineering applications. Our aim is to develop efficient numerical methods ...