A study on Koza's performance measures

作者：Barrero David F^*; Castano Bonifacio; R Moreno Maria D; Camacho David

来源：Genetic Programming and Evolvable Machines, 2015, 16(3): 327-349.

DOI：10.1007/s10710-014-9238-9

• Genetic Programming
• Computational effort
• Performance measures
• Experimental methods
• Measurement error

John R. Koza defined several metrics to measure the performance of an Evolutionary Algorithm that have been widely used by the Genetic Programming community. Despite the importance of these metrics, and the doubts that they have generated in many authors, their reliability has attracted little research attention, and is still not well understood. The lack of knowledge about these metrics has likely contributed to the decline in their usage in the last years. This paper is an attempt to increase the knowledge about these measures, exploring in which circumstances they are more reliable, providing some clues to improve how they are used, and eventually making their use more justifiable. Specifically, we investigate the amount of uncertainty associated with the measures, taking an analytical and empirical approach and reaching theoretical boundaries to the error. Additionally, a new method to calculate Koza's performance measures is presented. It is shown that these metrics, under common experimental configurations, have an unacceptable error, which can be arbitrary large in certain conditions.

• 出版日期2015-9