Abstract
Citation illustrates the link between citing and cited documents. Different aspects of achievements like the journal’s impact factor, author’s ranking, and peers’ judgment are analyzed using citations. However, citations are given the same weight for determining these important metrics. However academics contend that not all citations can ever have equal weight. Predominantly, such rankings are based on quantitative measures and the qualitative aspect is completely ignored. For a fair evaluation, qualitative evaluation of citations is needed in addition to quantitative ones. Many existing works that use qualitative evaluation consider binary class and categorize citations as important or unimportant. This study considers multi-class tasks for citation sentiments on imbalanced data and presents a novel framework for sentiment analysis in in-text citations of research articles. In the proposed technique, features are retrieved using a convolutional neural network (CNN), and classification is performed using a voting classifier that combines Logistic Regression (LR) and Stochastic Gradient Descent (SGD). The class imbalance problem is handled by the synthetic minority oversampling technique (SMOTE). Extensive experiments are performed in comparison with the proposed approach using SMOTE-generated data and machine learning models by term frequency (TF), and term frequency-inverse document frequency (TF-IDF) to evaluate the efficacy of the proposed approach for citation analysis. It is found that the proposed voting classifier using CNN features achieves an accuracy, precision, recall, and F1 score of 0.99 for all. This work not only advances the field of sentiment analysis in academic citations but also underscores the importance of incorporating qualitative aspects in evaluating the impact and sentiments conveyed through citations.
Funder
Prince sattam bin Abdulaziz University
Publisher
Public Library of Science (PLoS)
Reference47 articles.
1. Garfield, E. The use of journal impact factors and citation analysis for evaluation of science. 41st Annual Meeting Of The Council Of Biology Editors, Salt Lake City, UT. (1998).
2. Research evaluation and citation analysis: Key issues and implications;N Herther;The Electronic Library,2009
3. The correlation between citation counts and the 1992 research assessment exercise ratings for British research in genetics, anatomy and archaeology;C. Oppenheim;Journal Of Documentation,1997
4. An index to quantify an individual’s scientific research output;J Hirsch;Proceedings Of The National Academy Of Sciences,2005
5. The history and meaning of the journal impact factor;E Garfield;Jama,2006