A Pairwise Naive Bayes Approach to Bayesian Classification

作者：Asafu Adjei Josephine K^*; Betensky Rebecca A

来源：International Journal of Pattern Recognition and Artificial Intelligence, 2015, 29(7): 1550023.

DOI：10.1142/S0218001415500238

• Bayesian classification
• naive Bayes classifier
• optimal classification
• pairwise naive Bayes classifier
• semi-naive Bayes classifier

Despite the relatively high accuracy of the naive Bayes (NB) classifier, there may be several instances where it is not optimal, i.e. does not have the same classification performance as the Bayes classifier utilizing the joint distribution of the examined attributes. However, the Bayes classifier can be computationally intractable due to its required knowledge of the joint distribution. Therefore, we introduce a "pairwise naive" Bayes (PNB) classifier that incorporates all pairwise relationships among the examined attributes, but does not require specification of the joint distribution. In this paper, we first describe the necessary and sufficient conditions under which the PNB classifier is optimal. We then discuss sufficient conditions for which the PNB classifier, and not NB, is optimal for normal attributes. Through simulation and actual studies, we evaluate the performance of our proposed classifier relative to the Bayes and NB classifiers, along with the HNB, AODE, LBR and TAN classifiers, using normal density and empirical estimation methods. Our applications show that the PNB classifier using normal density estimation yields the highest accuracy for data sets containing continuous attributes. We conclude that it offers a useful compromise between the Bayes and NB classifiers.

• 出版日期2015-11