VaxBot-HPV: A GPT-based Chatbot for Answering HPV Vaccine-related Questions
Author:
Tao Cui1, Li Yiming2, Li Jianfu1, Li Manqi2, Yu Evan2, Amith Muhammad3, Tang Lu4, Savas Lara2, Cui Licong2
Affiliation:
1. Mayo Clinic 2. The University of Texas Health Science Center at Houston 3. The University of Texas Medical Branch at Galveston 4. Texas A&M University
Abstract
Abstract
Background: HPV vaccine is an effective measure to prevent and control the diseases caused by Human Papillomavirus (HPV). This study addresses the development of VaxBot-HPV, a chatbot aimed at improving health literacy and promoting vaccination uptake by providing information and answering questions about the HPV vaccine;
Methods: We constructed the knowledge base (KB) for VaxBot-HPV, which consists of 451 documents from biomedical literature and web sources on the HPV vaccine. We extracted 202 question-answer pairs from the KB and 39 questions generated by GPT-4 for training and testing purposes. To comprehensively understand the capabilities and potential of GPT-based chatbots, three models were involved in this study : GPT-3.5, VaxBot-HPV, and GPT-4. The evaluation criteria included answer relevancy and faithfulness;
Results: VaxBot-HPV demonstrated superior performance in answer relevancy and faithfulness compared to baselines (Answer relevancy: 0.85; Faithfulness: 0.97) for the test questions in KB, (Answer relevancy: 0.85; Faithfulness: 0.96) for GPT generated questions;
Conclusions: This study underscores the importance of leveraging advanced language models and fine-tuning techniques in the development of chatbots for healthcare applications, with implications for improving medical education and public health communication.
Publisher
Springer Science and Business Media LLC
Reference56 articles.
1. M. das G. P. Leto, G. F. dos Santos Júnior, A. M. Porro, and J. Tomimori, “Human papillomavirus infection: etiopathogenesis, molecular biology and clinical manifestations,” An. Bras. Dermatol., vol. 86, pp. 306–317, Apr. 2011, doi: 10.1590/S0365-05962011000200014. 2. P. Brianti, E. De Flammineis, and S. R. Mercuri, “Review of HPV-related diseases and cancers,” New Microbiol, vol. 40, no. 2, pp. 80–85, Apr. 2017. 3. F. S. Alhamlan, M. B. Alfageeh, M. A. Al Mushait, I. A. Al-Badawi, and M. N. Al-Ahdal, “Human Papillomavirus-Associated Cancers,” in Microbial Pathogenesis: Infection and Immunity, U. Kishore, Ed., Cham: Springer International Publishing, 2021, pp. 1–14. doi: 10.1007/978-3-030-67452-6_1. 4. C. Chelimo, T. A. Wouldes, L. D. Cameron, and J. M. Elwood, “Risk factors for and prevention of human papillomaviruses (HPV), genital warts and cervical cancer,” Journal of Infection, vol. 66, no. 3, pp. 207–217, Mar. 2013, doi: 10.1016/j.jinf.2012.10.024. 5. Cervical cancer in low and middle–income countries (Review);Hull R;Oncology Letters,2020
|
|