An application of Q-value-based dynamic programming with Boltzmann distribution to real-world road networks

作者：Yu Shanqing^*; Mabu Shingo; Mainali Manoj Kanta; Shimada Kaoru; Hirasawa Kotaro

来源：IEEJ Transactions on Electrical and Electronic Engineering, 2013, 8(2): 139-145.

DOI：10.1002/tee.21833

• dynamic traffic management
• Q-value-based dynamic programming with Boltzmann distribution
• real-world application

In order to alleviate traffic congestion and improve the efficiency of traffic systems from a global perspective, a dynamic traffic management model is proposed in this paper. The proposed model is applied to the large-scale microscopic simulator SOUND/4U based on the real-world road network of Kurosaki, Kitakyushu, Japan. All the vehicles in the simulator follow the direction from the route guidance of the dynamic traffic management model, in which the extended Q-value-based dynamic Programming with Boltzmann distribution (QDP-BD) and the time-varying traffic information are used to generate the routes from the origins to the destinations. The simulation results show that the proposed QDP-BD can reduce traffic congestion and improve the efficiency of the whole traffic system effectively compared with the greedy method in the real-world road network.

• 出版日期2013-3