Evaluating YouTube as a Source of Patient Information for Functional Endoscopic Sinus Surgery

Abstract

Objective: To evaluate the quality of information presented on YouTube regarding functional endoscopic sinus surgery (FESS) for patients. Methods: YouTube was searched using FESS-specific keywords under the setting of “relevance.” The first 50 videos from each keyword were reviewed and analyzed by 2 independent physician reviewers. Videos not related to FESS and duplicates were excluded. Outcome measures included the modified DISCERN score (range 0-5), the Journal of the American Medical Association ( JAMA) benchmark criteria (range: 0-4), a novel scoring checklist for FESS assessing usefulness (range: 0-16), and the Video Power Index (VPI). Intraclass correlation coefficient (ICC) was calculated. Results: Of the 200 videos identified, 95 videos were analyzed after exclusions. Videos had an average VPI of 40.8 and SD 133.2. Average scores from the 3 objective checklists among all videos were low: modified DISCERN: 1.91, SD: 1.15; JAMA benchmark: 1.91, SD: 0.76; and FESS score: 3.54, SD: 1.77. The ICC between the 2 independent reviewers was excellent for all 3 checklists. We noted significant positive Pearson correlation between all 3 checklist scores ( P < .001). In between-group comparisons of mean scores, there was significantly higher DISCERN and JAMA scores for videos from university/professional organizations, as compared to videos from medical advertising/for-profit companies and independent users. There were no significant differences in FESS scores noted between the 3 groups. Conclusion: There were overall low scores across the modified DISCERN, JAMA benchmark criteria, and FESS scoring checklists, reflecting the poor quality of YouTube videos as a source of patient information for FESS.