Author:
Zanwar Sourabh,Wiechmann Daniel,Qiao Yu,Kerz Elma
Abstract
AbstractThis paper presents our system employed for the Social Media Mining for Health 2023 Shared Task 4: Binary classification of English Reddit posts self-reporting a social anxiety disorder diagnosis. We systematically investigate and contrast the efficacy of hybrid and ensemble models that harness specialized medical domain-adapted transformers in conjunction with BiLSTM neural networks. The evaluation results outline that our best performing model obtained 89.31% F1 on the validation set and 83.76% F1 on the test set.
Publisher
Cold Spring Harbor Laboratory
Reference8 articles.
1. Emily Alsentzer , John Murphy , William Boag , Wei-Hung Weng , Di Jindi , Tristan Naumann , and Matthew McDermott . 2019. Publicly available clinical BERT embeddings. In Proceedings of the 2nd Clinical Natural Language Processing Workshop, pages 72–78. Association for Computational Linguistics.
2. Ensemble deep learning: A review
3. Shaoxiong Ji , Tianlin Zhang , Luna Ansari , Jie Fu , Prayag Tiwari , and Erik Cambria . 2022. Mental-BERT: Publicly available pretrained language models for mental healthcare. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 7184–7190, Marseille, France. European Language Resources Association.
4. Guidelines in major depressive disorder, and their limitations
5. AZ Klein , JM Banda , Y Guo , JI Flores Amaro , R Rodriguez-Esteban , A Sarker , AL Schmidt , D Xu , and G Gonzalez-Hernandez . 2023. Overview of the eighth social media mining for health applications (#smm4h) shared tasks at the AMIA 2023 annual symposium. Proceedings of the Eighth Social Media Mining for Health Applications (#SMM4H) Workshop and Shared Task.