Markov decision processes with iterated coherent risk measures

作者：Chu Shanyun; Zhang Yi^*

来源：International Journal of Control, 2014, 87(11): 2286-2293.

DOI：10.1080/00207179.2014.909947

• Markov decision process
• iterated coherent risk measure
• optimality equation

This paper considers a Markov decision process in Borel state and action spaces with the aggregated (or say iterated) coherent risk measure to be minimised. For this problem, we establish the Bellman optimality equation as well as the value and policy iteration algorithms, and show the existence of a deterministic stationary optimal policy. The cost function, while being allowed to be unbounded from below (in the sense that its negative part needs be bounded by some nonnegative real-valued possibly unbounded weight function), can be arbitrarily unbounded from above and possibly infinitely valued.

• 出版日期2014