ALR: accelerated higher-order logistic regression

作者：Zaidi Nayyar A^*; Webb Geoffrey I; Carman Mark J; Petitjean Francois; Cerquides Jesus

来源：Machine Learning, 2016, 104(2-3): 151-194.

DOI：10.1007/s10994-016-5574-8

• Higher-order Logistic Regression
• Low-bias classifiers
• Generative-discriminative learning

This paper introduces Accelerated Logistic Regression: a hybrid generative-discriminative approach to training Logistic Regression with high-order features. We present two main results: (1) that our combined generative-discriminative approach significantly improves the efficiency of Logistic Regression and (2) that incorporating higher order features (i.e. features that are the Cartesian products of the original features) reduces the bias of Logistic Regression, which in turn significantly reduces its error on large datasets. We assess the efficacy of Accelerated Logistic Regression by conducting an extensive set of experiments on 75 standard datasets. We demonstrate its competitiveness, particularly on large datasets, by comparing against state-of-the-art classifiers including Random Forest and Averaged n-Dependence Estimators.

• 出版日期2016-9