Building consensus on a set of ENDS-specific pictorial health warnings: a Delphi study among a tobacco control expert panel

Abstract

BackgroundThis study reports on the development of pictorial health warning labels for electronic nicotine delivery system (ENDS) using the Delphi approach with a panel of tobacco control experts. Twenty-four evidence-based ENDS-specific warnings corresponding to three themes (toxicity, health risks and specific harm) were developed and used in the Delphi study.MethodsWe conducted a three-round online Delphi study among 60 experts (55% female) between June 2022 and April 2023. We balanced the panel in areas of expertise and positions relevant to ENDS (risks, benefits). In round 1, participants rated the warnings on attention, relevance to evidence and perceived effectiveness (harm perception, motivation to quit) and provided suggestions for improvement. In rounds 2 and 3, participants ranked the revised warnings based on importance in each theme. We assessed levels of agreement between participants using interquartile deviations and medians.ResultsWarnings in theme 1, toxicity, received the highest ratings for perceived effectiveness on harm perception and encouraging quitting ENDS (p<0.05). Experts recommended using clear and affirmative text paired with emotion-provoking pictures and avoiding the rare side effects of ENDS. Most of the top-ranked warnings were from theme 3, ENDS-specific harm, pertained to lung damage, dual use of ENDS and cigarettes, nicotine addiction among youth, anti-ENDS industry sentiment and toxicity.DiscussionThis study developed 24 evidence-based ENDS health warning labels using a systematic process that included several rounds of expert panel feedback. These warnings can be used to advance ENDS prevention and tobacco control policies and further target different populations.