Author:
Singh Sharandeep,Bedi Jatin
Abstract
AbstractThis paper presents the system developed by Team ThaparUni for the Social Media Mining for Health Applications (SMM4H) 2023 Shared Task 4. The task involved binary classification of English Reddit posts, focusing on self-reporting social anxiety disorder (SAD) diagnoses. The final system employed a combination of three models: RoBERTa, ERNIE, and XLNet, and results obtained from all three models were integrated. The results, specifically in the context of mental health-related content analysis on social media platforms, show the possibility and viability of using multiple models in binary classification tasks.
Publisher
Cold Spring Harbor Laboratory
Reference8 articles.
1. RoBERTa: A robustly optimized BERT pretraining approach;arXiv preprint,2019
2. ERNIE 2.0: A continual pre-training framework for language understanding;InProceedings of the AAAI conference on artificial intelligence,2020
3. ERNIE: Enhanced language representation with informative entities;arXiv preprint,2019
4. Klein AZ , Banda JM , Guo Y , Flores Amaro JI , Rodriguez-Esteban R , Sarker A , Schmidt AL , Xu D , Gonzalez-Hernandez G. Overview of the eighth Social Media Mining for Health Applications (#SMM4H) Shared Tasks at the AMIA 2023 Annual Symposium. In: Proceedings of the Eighth Social Media Mining for Health Applications (#SMM4H) Workshop and Shared Task; 2023.
5. Yang Z , Dai Z , Yang Y , Carbonell J , Salakhutdinov RR, L. QV. XLNet: Generalized autoregressive pretraining for language understanding. Advances in neural information processing systems. 2019;32.