How Reliable Are Impact Factors for Ranking Water Resources Journals? An Analysis of the 70,878 Citation Records of the 2002 and 2021 Top 10 Journals for the Last Two Decades

Author:

Pauwels Valentijn R. N.1ORCID

Affiliation:

1. Department of Civil Engineering Monash University Clayton VIC Australia

Abstract

AbstractDespite regularly being criticized, the Impact Factor (IF) remains a widely used journal analysis metric. In the Water Resources category of the Web of Science, a thorough investigation of the reliability of this metric is lacking. This study analyzed the citation records of the top 10 journals from 2002 through 2021 for the last two decades. Important to note, there are inconsistencies in the Web of Science database. Contradictory to many fields, few papers are uncited. However, the Simpson paradox applies. More specifically, on the one hand, the correlation between citations to papers 7 years post publication and 1 or 2 years post publication (which determine the IF) has increased, which supports this metric. On the other hand, many of the most highly cited papers at the time of the IF calculation are lowly cited 5 years afterward. Additionally, most currently very highly cited papers were relatively uncited when they were used in the IF calculation. This raises doubt about the usefulness of this metric. For a limited number of journals, papers from individual nations strongly influence the IF. Also, for a few journals, the IFs are strongly influenced by review papers, but leaving these out of the IF does change the top 3 and 10 of the rankings. The general conclusion is that IFs do contain some valuable information about the journals' citation impact, but that using them to rank journals is questionable practice.

Publisher

American Geophysical Union (AGU)

Subject

Water Science and Technology

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3