Enhancing Topic Prediction Using Machine Learning Techniques and ConceptNet-based Cosine Similarity Measure-Reference-Cited by-同舟云学术

Enhancing Topic Prediction Using Machine Learning Techniques and ConceptNet-based Cosine Similarity Measure

Published:2023-07-19 Issue: Volume: Page:
ISSN:
Container-title:
language:
Short-container-title:

Author:

Kaur Ashpreet¹,Singh Bhavneet¹,Nandi Basanti Pal¹,Jain Amita²,Tayal Devendra Kumar³

Affiliation:

1. Guru Gobind Singh Indraprastha University

2. Netaji Subhas University of Technology

3. Indira Gandhi Delhi Technical University for Women

Abstract

Abstract Topic modelling is one of the important research area of Natural Language Processing. Researchers have tried topic modelling for classification, categorization etc., and even the methods of topic modelling are used for sentiment analysis and other areas of language processing. In this paper, a novel method based on cosine similarity is used for topic modelling using Machine Learning Techniques. Cosine similarity measure on synonyms of topics present in the BBC News and Yahoo datasets from Concept Net is a pioneering approach. It has been observed that machine learning techniques applied here enhance accuracy compared to previously applied methods on these two datasets. On Yahoo datasets, the proposed technique increases the accuracy by 8% even over deep learning methods, which shows the efficiency and applicability of the research. Uses of ConceptNet is a novel idea over here, and the combination of ConceptNet with machine learning made the effort successful in comparison to existing state-of-the-art research on topic modelling.

Publisher

Research Square Platform LLC

Reference30 articles.

1. Cao Z et al (2015) "A novel neural topic model and its supervised extension." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 29. No. 1.

2. Fuzzy approach topic discovery in health and medical corpora;Karami A;Int J Fuzzy Syst,2018

3. "Character-level convolutional networks for text classification;Zhang X;Adv Neural Inf Process Syst,2015

4. Conneau A et al (2016) "Very deep convolutional networks for text classification." arXiv preprint arXiv:1606.01781

5. Johnson R, Zhang T (2017) "Deep pyramid convolutional neural networks for text categorization." Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).