Approximate Dynamic Programming for Two-player Zero-sum Game Related to H-infinity Control of Unknown Nonlinear Continuous-time Systems

作者：Yasini Sholeh; Bagher Mohammad; Sistani Naghibi^*; Karimpour Ali

来源：International Journal of Control Automation and Systems, 2015, 13(1): 99-109.

DOI：10.1007/s12555-014-0085-5

• Approximate dynamic programming
• concurrent learning
• H-infinity control
• neural networks
• two-player zero-sum game
• unknown dynamics

This paper develops a concurrent learning-based approximate dynamic programming (ADP) algorithm for solving the two-player zero-sum (ZS) game arising in H-infinity control of continuous-time (CT) systems with unknown nonlinear dynamics. First, the H-infinity control is formulated as a ZS game and then, an online algorithm is developed that learns the solution to the Hamilton-Jacobi-Isaacs (HJI) equation without using any knowledge on the system dynamics. This is achieved by using a neural network (NN) identifier to approximate the uncertain system dynamics. The algorithm is implemented on actor-critic-disturbance NN structure along with the NN identifier to approximate the optimal value function and the corresponding Nash solution of the game. All NNs are tuned at the same time. By using the idea of concurrent learning the need to check for the persistency of excitation condition is relaxed to simplified condition. The stability of the overall system is guaranteed and the convergence to the Nash solution of the game is shown. Simulation results show the effectiveness of the algorithm.

• 出版日期2015-2