Virtual Assistants’ Response to Queries About Nicotine Replacement Therapy: A Mixed-Method Analysis

Abstract

This study focused on investigating the potential of Artificial Intelligent-powered Virtual Assistants (VAs) such as Amazon Alexa, Apple Siri, and Google Assistant as tools to help individuals seeking information about Nicotine Replacement Treatment (NRT) for smoking cessation. The researchers asked 40 NRT-related questions to each of the 3 VAs and evaluated the responses for voice recognition. The study used a cross-sectional mixed-method design with a total sample size of 360 responses. Inter-rater reliability and differences between VAs’ responses were examined by SAS software, and qualitative assessments were conducted using NVivo software. Google Assistant achieved 100% voice recognition for NRT-related questions, followed by Apple Siri at 97.5%, and Amazon Alexa at 83.3%. Statistically significant differences were found between the responses of Amazon Alexa relative to both Google Assistant and Apple Siri. Researcher 1’s ratings significantly differed from Researcher 2’s ( p = .001), but not from Researcher 3’s ( p = .11). Virtual Assistants occasionally struggled to understand the context or nuances of questions, lacked in-depth information in their responses, and provided generic or unrelated responses. Virtual Assistants have the potential to be incorporated into smoking cessation interventions and tobacco control initiatives, contingent upon improving their competencies.