Effectiveness of Google keyword suggestion on users’ relevance judgment
Author:
Fattahi Rahmatollah,Parirokh Mehri,Dayyani Mohammd Hosien,Khosravi Abdolrasoul,Zareivenovel Mojgan
Abstract
Purpose
– One of the most effective ways information retrieval (IR) systems including Web search engines can improve relevance performance is to provide their users with tools for facilitating query expansion. Search engines such as Google provide users with keyword suggest tools. This paper aims to investigate users’ criteria in relevance judgment regarding Google’s keywords suggest tool and to see how such keywords would lead to more relevant results from the viewpoint of users.
Design/methodology/approach
– Through a mixed method approach, quantitative and qualitative data were collected from 60 postgraduate students at Ferdowsi University of Mashhad, Iran, using four different instruments (questionnaire, thinking aloud technique, query logs and interviews).
Findings
– Among other criteria, the “relation between suggested keywords and the information need” (with the mean rate of 3.53 of four) was considered the most important by searchers in selecting suggested keywords for query expansion. Also, the “relation between suggested Keywords and the retrieved items” (with the mean rate of 3.62) was considered the second most important criterion in judging the relevance of the retrieved results. The participants agreed that the suggested keywords by Google improved the retrieval relevance. The content analysis of the participants’ aloud-thinking sessions and the interviews approved such findings.
Originality/value
– This research makes a contribution to the need of designers of IR systems regarding the use of add words for query expansion. It also helps librarians how to instruct searchers with expanding their queries to retrieve more relevant results. Another contribution of the study is the identification of a number of new relevance judgment criteria for Web-based environments.
Subject
Library and Information Sciences,Computer Science Applications
Reference41 articles.
1. Abam, Z.
(2010), “The study of users’ browsing behavior and relevance judgment in web-based meta-link environment”, PhD Dissertation, Library and Information Science, Ferdowsi University of Mashhsad, Mashhsad 2. Ahn, M.
(2003), “Exploring factors affecting users’ link-following decision and evaluation behavior during web browsing”, PhD Thesis, School of Information Studies, University of Pittsburgh, Pittsburgh, PA. 3. Andreou, A.
(2005), “Ontologies and query expansion”, Master’s thesis, School of Informatics, University of Edinburgh, Edinburgh. 4. Anick, P.
(2003), “Using terminological feedback for web search refinement: a log-based study”, Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, Bethesda, MD, pp. 88-95. 5. Baeza-Yates, R.
,
Hurtado, C.A.
and
Mendoza, M.
(2004), “Query recommendation using query logs in search engines”, in
Lindner, W.
,
Mesiti, M.
,
Türker, C.
,
Tzitzikas, Y.
and
Vakali, A.
(Eds),
EDBT Workshops
, Springer, New York, NY, pp. 588-596.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|