A new dataset evaluation method based on category overlap

作者：Oh Sejong^*

来源：Computers in Biology and Medicine, 2011, 41(2): 115-122.

DOI：10.1016/j.compbiomed.2010.12.006

• Feature
• Feature selection
• R-value
• Dataset
• Classification
• Machine learning algorithm

The quality of dataset has a profound effect on classification accuracy, and there is a clear need for some method to evaluate this quality. In this paper, we propose a new dataset evaluation method using the R-value measure. This proposed method is based on the ratio of overlapping areas among categories in a dataset. A high R-value for a dataset indicates that the dataset contains wide overlapping areas among its categories, and classification accuracy on the dataset may become low. We can use the R-value measure to understand the characteristics of a dataset, the feature selection process, and the proper design of new classifiers.

• 出版日期2011-2