Affiliation:
1. P. G. Demidov Yaroslavl State University
Abstract
The research is devoted to classification of news articles about P. G. Demidov Yaroslavl State University (YarSU) into 4 categories: “society”, “education”, “science and technologies”, “not relevant”.The proposed approaches are based on using the BERT neural network and methods of machine learning: SVM, Logistic Regression, K-Neighbors, Random Forest, in combination of different embedding types: Word2Vec, FastText, TF-IDF, GPT-3. Also approaches of text preprocessing are considered to achieve higher quality of the classification. The experiments showed that the SVM classifier with TF-IDF embedding and trained on full article texts with titles achieved the best result. Its micro-F-measure and macro-F-measure are 0.8214 and 0.8308 respectively. The BERT neural network trained on fragments of paragraphs with YarSU mentions, from which the first 128 words and the last 384 words were taken, showed comparable results. The resulting micro-F-measure and macro-F-measure are 0.8304 and 0.8181 respectively. Thus, using paragraphs with the target organisation mentions is enough to classify text by categories efficiently.
Publisher
P.G. Demidov Yaroslavl State University
Subject
Industrial and Manufacturing Engineering,Polymers and Plastics,Business and International Management
Reference16 articles.
1. A. Hussain, G. Ali, F. Akhtar, Z. H. Khand, and A. Ali, “Design and analysis of news category predictor”, Engineering, Technology & Applied Science Research, vol. 10, no. 5, pp. 6380-6385, 2020.
2. G. Kaur and K. Bajaj, “News classification using neural networks”, Communications on applied electronics, vol. 5, no. 1, pp. 42-45, 2016.
3. P. Semberecki and H. Maciejewski, “Deep learning methods for subject text classification of articles”, in 2017 Federated Conference on Computer Science and Information Systems (FedCSIS), IEEE, 2017, pp. 357-360.
4. X. Luo, “Efficient English text classification using selected machine learning techniques”, Alexandria Engineering Journal, vol. 60, no. 3, pp. 3401-3409, 2021.
5. S. Vychegzhanin, E. Kotelnikov, and V. Milov, “Comparative analysis of machine learning methods for news categorization in Russian”, in CEUR Workshop Proceedings, vol. 2922, 2021, pp. 100-108.