Affiliation:
1. Tsinghua University, Beijing, China
2. Huawei Noah's Ark Lab, China
3. Tencent, China
Abstract
Relevance estimation is among the most important tasks in the ranking of search results. Current methodologies mainly concentrate on text matching, link analysis, and user behavior models. However, users judge the relevance of search results directly from Search Engine Result Pages (SERPs), which provide valuable signals for reranking. In this article, we propose two different approaches to aggregate the visual, structure, as well as textual information sources of search results in relevance estimation. The first one is a late-fusion framework named Joint Relevance Estimation model (JRE). JRE estimates the relevance independently from screenshots, textual contents, and HTML source codes of search results and jointly makes the final decision through an inter-modality attention mechanism. The second one is an early-fusion framework named Tree-based Deep Neural Network (TreeNN), which embeds the texts and images into the HTML parse tree through a recursive process. To evaluate the performance of the proposed models, we construct a large-scale practical Search Result Relevance (SRR) dataset that consists of multiple information sources and relevance labels of over 60,000 search results. Experimental results show that the proposed two models achieve better performance than state-of-the-art ranking solutions as well as the original rankings of commercial search engines.
Funder
National Key Basic Research Program
Natural Science Foundation of China
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Science Applications,General Business, Management and Accounting,Information Systems
Reference57 articles.
1. The impact of visual appearance on user response in online display advertising
2. Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.
3. A dynamic bayesian network click model for web search ranking
4. Beyond ten blue links
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Fake Review Detection System: A Review;International Journal of Scientific Research in Science and Technology;2023-05-03
2. User Behavior Simulation for Search Result Re-ranking;ACM Transactions on Information Systems;2023-01-20
3. Exploiting Real-time Search Engine Queries for Earthquake Detection: A Summary of Results;ACM Transactions on Information Systems;2021-07-26
4. Context-Aware Ranking by Constructing a Virtual Environment for Reinforcement Learning;Proceedings of the 28th ACM International Conference on Information and Knowledge Management;2019-11-03