Citation metrics and evaluation of journals and conferences

Abstract

Citation analysis aims at evaluating the published scientific manuscripts, their authors and the publication venues (journals/conferences). There are several popular metrics for measuring the impact of the journals, the Impact Factor (IF) being the most popular. Similarly, the [Formula: see text]-index is a popular metric for evaluating and ranking conferences. We have presented a review of metrics for citation analysis, categorised according to their applicability for evaluating journals and conferences. The citation metrics may also be categorised as popularity measuring and prestige measuring. Prestige measuring indicators like SCImago Journal Rank (SJR) and Eigenfactor have already gained popularity for evaluating journals. We discuss their role in evaluating the conferences. Indeed, some conferences have already started mentioning their prestige score in terms of the SJR of their conference proceedings. We also propose a Normalised Immediacy Index ([Formula: see text]), a variant of the Immediacy Index ([Formula: see text]), to measure the immediate relevance of articles published in a journal/conference. It is shown that the proposed metric can be used for immediacy relevance comparison irrespective of the publication schedule of the articles. Spearman correlation was run to determine the relationship between the values of the proposed [Formula: see text] and traditional metrics ([Formula: see text]-index for conferences and IF for journals). A strong, positive monotonic correlation was observed between [Formula: see text] and H-index ([Formula: see text] = .67, [Formula: see text] = 17, [Formula: see text] < .01) for conferences and between [Formula: see text] and IF ([Formula: see text] = .65, [Formula: see text] = 20, [Formula: see text] < .01) for journals.