A Finite Convergence Criterion for the Discounted Optimal Control of Stochastic Logical Networks

作者：Wu, Yuhu; Shen, Tielong^*

来源：IEEE Transactions on Automatic Control, 2018, 63(1): 262-268.

DOI：10.1109/TAC.2017.2720730

• Boolean networks
• logical networks (LN)
• optimal control
• semi-tensor product
• stochastic logical networks (SLNs)

Stochastic logical networks (SLNs) are discrete-time stochastic dynamical systems with Boolean (or multivalued) logical state variables. The discounted infinite horizon optimal control problem for SLN is addressed in this paper. By resorting to the equivalent Markov decision process description, the infinite horizon optimization problem is presented in algebraic form. Then using the increasing-dimension technique, an improved finite convergence criterion, which can find the optimal stationary policy, is derived for value iteration approach. To demonstrate the theoretical value of this approach, it is applied to the optimization problems of the human-machine game and the p53-Mdm2 gene network.

• 出版日期2018-1
• 单位大连理工大学