Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling (Preprint)

Author:

Moy Amanda JORCID,Withall JenniferORCID,Hobensack MollieORCID,Yeji Lee RachelORCID,Levy Deborah RORCID,Rossetti Sarah CORCID,Rosenbloom S TrentORCID,Johnson KevinORCID,Cato KenrickORCID

Abstract

BACKGROUND

Addressing clinician documentation burden through “targeted solutions” is a growing priority for many organizations ranging from government and academia to industry. Between January and February 2021, the 25 by 5: Symposium to Reduce Documentation Burden on US Clinicians by 75% (25X5 Symposium) convened across 2 weekly 2-hour sessions among experts and stakeholders to generate actionable goals for reducing clinician documentation over the next 5 years. Throughout this web-based symposium, we passively collected attendees’ contributions to a chat functionality—with their knowledge that the content would be deidentified and made publicly available. This presented a novel opportunity to synthesize and understand participants’ perceptions and interests from chat messages. We performed a content analysis of 25X5 Symposium chat logs to identify themes about reducing clinician documentation burden.

OBJECTIVE

The objective of this study was to explore unstructured chat log content from the web-based 25X5 Symposium to elicit latent insights on clinician documentation burden among clinicians, health care leaders, and other stakeholders using topic modeling.

METHODS

Across the 6 sessions, we captured 1787 messages among 167 unique chat participants cumulatively; 14 were private messages not included in the analysis. We implemented a latent Dirichlet allocation (LDA) topic model on the aggregated dataset to identify clinician documentation burden topics mentioned in the chat logs. Coherence scores and manual examination informed optimal model selection. Next, 5 domain experts independently and qualitatively assigned descriptive labels to model-identified topics and classified them into higher-level categories, which were finalized through a panel consensus.

RESULTS

We uncovered ten topics using the LDA model: (1) <i>determining data and documentation needs</i> (422/1773, 23.8%); (2) <i>collectively reassessing documentation requirements in electronic health records</i> (EHRs) (252/1773, 14.2%); (3) <i>focusing documentation on patient narrative</i> (162/1773, 9.1%); (4) <i>documentation that adds value</i> (147/1773, 8.3%); (5) <i>regulatory impact on clinician burden</i> (142/1773, 8%); (6) <i>improved EHR user interface and design</i> (128/1773, 7.2%); (7) <i>addressing poor usability</i> (122/1773, 6.9%); (8) <i>sharing 25X5 Symposium resources</i> (122/1773, 6.9%); (9) <i>capturing data related to clinician practice</i> (113/1773, 6.4%); and (10) <i>the role of quality measures and technology in burnout</i> (110/1773, 6.2%). Among these 10 topics, 5 high-level categories emerged: <i>consensus building</i> (821/1773, 46.3%), <i>burden sources</i> (365/1773, 20.6%), <i>EHR design</i> (250/1773, 14.1%), <i>patient-centered care</i> (162/1773, 9.1%), and <i>symposium comments</i> (122/1773, 6.9%).

CONCLUSIONS

We conducted a topic modeling analysis on 25X5 Symposium multiparticipant chat logs to explore the feasibility of this novel application and elicit additional insights on clinician documentation burden among attendees. Based on the results of our LDA analysis, consensus building, burden sources, EHR design, and patient-centered care may be important themes to consider when addressing clinician documentation burden. Our findings demonstrate the value of topic modeling in discovering topics associated with clinician documentation burden using unstructured textual content. Topic modeling may be a suitable approach to examine latent themes presented in web-based symposium chat logs.

Publisher

JMIR Publications Inc.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3