A Cooperative Coevolution Framework for Parallel Learning to Rank

作者:Wang Shuaiqiang*; Wu Yun; Gao Byron J; Wang Ke; Lauw Hady W; Ma Jun
来源:IEEE Transactions on Knowledge and Data Engineering, 2015, 27(12): 3152-3165.
DOI:10.1109/TKDE.2015.2453952

摘要

We propose CCRank, the first parallel framework for learning to rank based on evolutionary algorithms (EA), aiming to significantly improve learning efficiency while maintaining accuracy. CCRank is based on cooperative coevolution ( CC), a divide-and-conquer framework that has demonstrated high promise in function optimization for problems with large search space and complex structures. Moreover, CC naturally allows parallelization of sub-solutions to the decomposed sub-problems, which can substantially boost learning efficiency. With CCRank, we investigate parallel CC in the context of learning to rank. We implement CCRank with three EA-based learning to rank algorithms for demonstration. Extensive experiments on benchmark datasets in comparison with the state-of-the-art algorithms show the performance gains of CCRank in efficiency and accuracy.