A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices

作者：Sharma Alok^*; Paliwal Kuldip K

来源：Pattern Recognition, 2012, 45(6): 2205-2213.

DOI：10.1016/j.patcog.2011.11.018

• Null LDA
• Small Sample Size Problem
• Dimensionality Reduction

Null linear discriminant analysis (LDA) method is a popular dimensionality reduction method for solving small sample size problem. The implementation of null LDA method is, however, computationally very expensive. In this paper, we theoretically derive the null LDA method from a different perspective and present a computationally efficient implementation of this method. Eigenvalue decomposition (EVD) of ST+SB (where S-B is the between-class scatter matrix and S-T(+) is the pseudoinverse of the total scatter matrix S-T) is shown here to be a sufficient condition for the null LDA method. As EVD of ST+SB is computationally expensive, we show that the utilization of random matrix together with ST+SB is also a sufficient condition for null LDA method. This condition is used here to derive a computationally fast implementation of the null LDA method. We show that the computational complexity of the proposed implementation is significantly lower than the other implementations of the null LDA method reported in the literature. This result is also confirmed by conducting classification experiments on several datasets.

• 出版日期2012-6
• 单位河北医科大学