A concept language model for ad-hoc retrieval

作者：Zou, Bin; Lampos, Vasileios; Liang, Shangsong; Ren, Zhaochun; Yilmaz, Emine; Cox, Ingemar

来源：26th International World Wide Web Conference, WWW 2017 Companion, 2017-04-03 To 2017-04-07.

DOI：10.1145/3041021.3054209

• Ad Hoc retrieval
• Benchmark datasets
• Language model
• Query terms
• Search terms
• State of the art

We propose an extension to language models for information retrieval. Typically, language models estimate the probability of a document generating the query, where the query is considered as a set of independent search terms. We extend this approach by considering the concepts implied by both the query and words in the The model combines the probability of the document generating the concept embodied by the query, and the traditional language model probability of the document generating the query terms. We use a word embedding space to express concepts. The similarity between two vectors in this space is estimated using a weighted cosine distance. The weighting significantly enhances the discrimination between vectors. We evaluate our model on benchmark datasets (TREC 6-8) and empirically demonstrate it outperforms state-of-the-art baselines.

• 出版日期2019
• 单位university college london