A policy approximation method for the UMTS connection admission control problem modelled as an MDP

作者：Pietrabissa Antonio^*

来源：International Journal of Control, 2009, 82(10): 1814-1827.

DOI：10.1080/00207170902774233

• Markov decision processes
• connection admission control
• approximated dynamic programming
• communication networks
• UMTS networks

This article presents a connection admission control (CAC) algorithm for UMTS networks based on the Markov decision process (MDP) approach. To deal with the non-stationary environment due to the time-varying statistical characteristics of the offered traffic, the admission policy has to be computed periodically based on on-line measurements, and the optimal policy computation is excessively time-consuming to be performed on-line. Thus, this article proposes a reduction of the policy space coupled with an aggregation of the state space for the fast computation of a sub-optimal admission policy. Theoretical results and numerical simulations show the effectiveness of the proposed approach.

• 出版日期2009