A Recursive Classifier System for Partially Observable Environments

作者：Hamzeh Ali^*; Hashemi Sattar; Sami Ashkan; Rahmani Adel

来源：Fundamenta Informaticae, 2009, 97(1-2): 15-40.

DOI：10.3233/FI-2009-191

• Learning Classifier Systems
• Partially Observable Environments
• XCS
• CSXCS

Previously we introduced Parallel Specialized XCS (PSXCS), a distributed-architecture classifier system that detects aliased environmental states and assigns their handling to created subordinate XCS classifier systems. PSXCS uses a history-window approach, but with novel efficiency since the subordinate XCSs, which employ the windows, are only spawned for parts of the state space that are actually aliased. However, because the window lengths are finite and set manually, PSXCS may fail to be optimal in difficult test mazes. This paper introduces Recursive PSXCS (RPSXCS) that automatically spawns windows wherever more history is required. Experimental results show that RPSXCS is both more powerful and learns faster than PSXCS. The present research suggests new potential for history approaches to partially observable environments.

• 出版日期2009