A novel virtual sample generation method based on Gaussian distribution

作者：Yang, Jing^*; Yu, Xu; Xie, Zhi-Qiang; Zhang, Jian-Pei

来源：Knowledge-Based Systems, 2011, 24(6): 740-748.

DOI：10.1016/j.knosys.2010.12.010

• Virtual sample
• Regularization theory
• Cost-sensitive learning
• Gaussian distribution
• Prior knowledge

Traditional machine learning algorithms are not with satisfying generalization ability on noisy, imbalanced, and small sample training set. In this work, a novel virtual sample generation (VSG) method based on Gaussian distribution is proposed. Firstly, the method determines the mean and the standard error of Gaussian distribution. Then, virtual samples can be generated by such Gaussian distribution. Finally, a new training set is constructed by adding the virtual samples to the original training set. This work has shown that training on the new training set is equivalent to a form of regularization regarding small sample problems, or cost-sensitive learning regarding imbalanced sample problems. Experiments show that given a suitable number of virtual sample replicates, the generalization ability of the classifiers on the new training sets can be better than that on the original training sets.

• 出版日期2011-8
• 单位哈尔滨工程大学; 哈尔滨学院