An efficient manifold regularized sparse non-negative matrix factorization model for large-scale recommender systems on GPUs

作者：Li, Hao; Li, Keqin; An, Jiyao; Zheng, Weihua; Li, Kenli

来源：Information Sciences, 2019, 496: 464-484.

DOI：10.1016/j.ins.2018.07.060

• Collaborative filtering recommender systems
• Data mining
• Euclidean distance and KL-divergence
• GPU parallelization
• Manifold regularization
• Non-negative matrix factorization

Non-negative Matrix Factorization (NMF) plays an important role in many data mining applications for low-rank representation and analysis. Due to the sparsity that is caused by missing information in many high-dimension scenes, e.g., social networks or recommender systems, NMF cannot mine a more accurate representation from the explicit information. Manifold learning can incorporate the intrinsic geometry of the data, which is combined with a neighborhood with implicit information. Thus, manifold-regularized NMF (MNMF) can realize a more compact representation for the sparse data. However, MNMF suffers from (a) the forming of large-scale Laplacian matrices, (b) frequent large-scale matrix manipulation, and (c) the involved K-nearest neighbor points, which will result in the over-writing problem in parallelization. To address these issues, a single-thread-based MNMF model is proposed on two types of divergence, i.e., Euclidean distance and Kullback-Leibler (KL) divergence, which depends only on the involved feature-tuples' multiplication and summation and can avoid large-scale matrix manipulation. Furthermore, this model can remove the dependence among the feature vectors with fine-grain parallelization inherence. On that basis, a CUDA parallelization MNMF (CUMNMF) is presented on GPU computing. From the experimental results, CUMNMF achieves a 20X speedup compared with MNMF, as well as a lower time complexity and space requirement.

• 出版日期2019-9
• 单位湖南工业大学; 湖南大学