Distributed collaborative filtering with singular ratings for large scale recommendation

作者：Xu Ruzhi; Wang Shuaiqiang^*; Zheng Xuwei; Chen Yinong

来源：Journal of Systems and Software, 2014, 95: 231-241.

DOI：10.1016/j.jss.2014.04.045

• Collaborative filtering
• Recommender systems
• Distributed framework

Collaborative filtering (CF) is an effective technique addressing the information overloading problem, where each user is associated with a set of rating scores on a set of items. For a chosen target user, conventional CF algorithms measure similarity between this user and other users by utilizing pairs of rating scores on common rated items, but discarding scores rated by one of them only. We call these comparative scores as dual ratings, while the non-comparative scores as singular ratings. Our experiments show that only about 10% ratings are dual ones that can be used for similarity evaluation, while the other 90% are singular ones. In this paper, we propose SingCF approach, which attempts to incorporate multiple singular ratings, in addition to dual ratings, to implement collaborative filtering, aiming at improving the recommendation accuracy. We first estimate the unrated scores for singular ratings and transform them into dual ones. Then we perform a CF process to discover neighborhood users and make predictions for each target user. Furthermore, we provide a MapReduce-based distributed framework on Hadoop for significant improvement in efficiency. Experiments in comparison with the state-of-the-art methods demonstrate the performance gains of our approaches.

• 出版日期2014-9
• 单位山东财经大学