Evaluating Academic Journals without Impact Factors for Collection Management Decisions

Abstract

Evaluation of academic journals for collection management decisions is made all the more difficult when some journals do not have impact factors as assigned by the Institute for Scientific Information and its Journal Citation Reports. Focusing on science, technology, and medicine journals, this study presents a method of evaluating such nonranked journals. The method is based on finding a comparator journal to the nonranked journal, distinguishing between original research articles and other article types, tracing citations to these two target journals in citing journals, comparing the quality of the citing journals that cite both target journals, and describing the contextual typology of the citations to the target journals. A case study of two medical science journals, the nonranked Annals of the Royal College of Physicians and Surgeons of Canada and the comparator ranked Canadian Family Physician, illustrates the method. This method can help in determining the value of a nonranked journal in relation to a ranked journal.