Abstract
AbstractStudent opinions for a course are important to educators and administrators, regardless of the type of the course or the institution. Reading and manually analyzing open-ended feedback becomes infeasible for massive volumes of comments at institution level or online forums. In this paper, we collected and pre-processed a large number of course reviews publicly available online. We applied machine learning techniques with the goal to gain insight into student sentiments and topics. Specifically, we utilized current Natural Language Processing (NLP) techniques, such as word embeddings and deep neural networks, and state-of-the-art BERT (Bidirectional Encoder Representations from Transformers), RoBERTa (Robustly optimized BERT approach) and XLNet (Generalized Auto-regression Pre-training). We performed extensive experimentation to compare these techniques versus traditional approaches. This comparative study demonstrates how to apply modern machine learning approaches for sentiment polarity extraction and topic-based classification utilizing course feedback. For sentiment polarity, the top model was RoBERTa with 95.5% accuracy and 84.7% F1-macro, while for topic classification, an SVM (Support Vector Machine) was the top classifier with 79.8% accuracy and 80.6% F1-macro. We also provided an in-depth exploration of the effect of certain hyperparameters on the model performance and discussed our observations. These findings can be used by institutions and course providers as a guide for analyzing their own course feedback using NLP models towards self-evaluation and improvement.
Publisher
Springer Science and Business Media LLC
Subject
Library and Information Sciences,Education
Reference50 articles.
1. Abbas, A., Haruna, H., Arrona-Palacios, A., et al. (2022) Students’ evaluations of teachers and recommendation based on course structure or teaching approaches: an empirical study based on the institutional dataset of student opinion survey. Education and Information Technologies, pp. 1–16
2. Altrabsheh, N., Cocea, M., Fallahkhair, S. (2014) Sentiment analysis: towards a tool for analysing real-time students feedback. In: IEEE international conference on tools with artificial intelligence, pp. 419–423
3. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022.
4. Chen, X., Vorvoreanu, M., & Madhavan, K. (2014). Mining social media data for understanding students’ learning experiences. IEEE Transactions on Learning Technologies, 7(3), 246–259.
5. Clavié, B., Gal, K. (2019) Edubert: pretrained deep language models for learning analytics. arXiv:1912.00690
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献