A general fuzzified CMAC based reinforcement learning control for ship steering using recursive least-squares algorithm

作者：Shen, Zhipeng^*; Guo, Chen; Zhang, Ning

来源：Neurocomputing, 2010, 73(4-6): 700-706.

DOI：10.1016/j.neucom.2009.03.021

• Cerebellar model articulation controller
• Recursive least-squares algorithm
• Reinforcement learning
• Ship steering
• Temporal difference

A general fuzzified cerebellar model articulation controller (GFCMAC) is proposed. The mapping of receptive field functions, the selection law of membership function and the learning algorithm are presented. Recursive least-squares temporal difference algorithm (RLS-TD) is deduced, which can use data efficiently with faster convergence and less computational burden. Using RLS-TD method a reinforcement learning structure based on GFCMAC is applied to ship steering control, as provides an efficient way for the improvement of ship steering control performance. The parameters of controller are online learned and adjusted. Simulation results show that the ship course can be properly controlled in case of the disturbances of wave and wind. It is demonstrated that the proposed algorithm is a promising alternative to conventional autopilots.

• 出版日期2010-1
• 单位大连海事大学