Abstract
AbstractRelevance is a key element for analyzing bibliometrics and information retrieval (IR). In both domains, relevance decisions are discussed theoretically and sometimes evaluated in empirical studies. IR research is often based on test collections for which explicit relevance judgments are made, while bibliometrics is based on implicit relevance signals like citations or other non-traditional quantifiers like altmetrics. While both types of relevance decisions share common concepts, it has not been empirically investigated how they relate to each other on a larger scale. In this work, we compile a new dataset that aligns IR relevance judgments with traditional bibliometric relevance signals (and altmetrics) for life sciences and physics publications. The dataset covers PubMed and arXiv articles, for which relevance judgments are taken from TREC Precision Medicine and iSearch, respectively. It is augmented with bibliometric data from the Web of Science and Altmetrics. Based on the reviewed literature, we outline a mental framework supporting the answers to our research questions. Our empirical analysis shows that bibliometric (implicit) and IR (explicit) relevance signals are correlated. Likewise, there is a high correlation between biblio- and altmetrics, especially for documents with explicit positive relevance judgments. Furthermore, our cross-domain analysis demonstrates the presence of these relations in both research fields.
Funder
deutsche forschungsgemeinschaft
bundesministerium für bildung und forschung
Technische Hochschule Köln
Publisher
Springer Science and Business Media LLC
Subject
Library and Information Sciences,Computer Science Applications,General Social Sciences
Reference56 articles.
1. Archambault É, Beauchesne, O.H., Caruso, J. (2011). Towards a multilingual, comprehensive and open scientific journal ontology. In Proc. of ISSI 2011, Durban South Africa, pp. 66–77.
2. Ashford SJ (1986) Feedback-Seeking in Individual Adaptation: A Resources Perspective. Academy of Management Journal 29(3):465–487. https://doi.org/10.2307/256219.
3. Ball, R., & Tunger, D. (2006). Bibliometric analysis - A new business area for information professionals in libraries? Scientometrics, 66(3), 561–577.
4. Beel, J., Gipp, B. (2009). Google Scholar’s Ranking Algorithm: An Introductory Overview. In: Proceedings of the 12th International Conference on Scientometrics and Informetrics (ISSI’09), International Society for Scientometrics and Informetrics, vol 1, pp. 230–241.
5. Borlund, P. (2003). The concept of relevance in IR. Journal of the American Society for Information Science and Technology, 54(10), 913–925. https://doi.org/10.1002/asi.10286
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献