Addressing overfitting and underfitting in Gaussian model-based clustering

作者：Andrews Jeffrey L^*

来源：Computational Statistics & Data Analysis, 2018, 127: 160-171.

DOI：10.1016/j.csda.2018.05.015

• EM algorithm
• Bootstrap
• Cluster analysis
• Mixture models

The expectation-maximization (EM) algorithm is a common approach for parameter estimation in the context of cluster analysis using finite mixture models. This approach suffers from the well-known issue of convergence to local maxima, but also the less obvious problem of overfitting. These combined, and competing, concerns are illustrated through simulation and then addressed by introducing an algorithm that augments the traditional EM with the nonparametric bootstrap. Further simulations and applications to real data lend support for the usage of this bootstrap augmented EM-style algorithm to avoid both overfitting and local maxima.

• 出版日期2018-11