Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines

Author:

Yang Nan12,Liu Hui23,Zhao Wei4,Pan Yang5,Lyu Xiangzheng6,Hao Xiuyuan7,Liu Xiaoqing8,Qi Wen’an9,Chen Tong10,Wang Xiaoqin11,Zhang Boheng12,Zhang Weishe13,Li Qiu14,Xu Dong15,Gao Xinghua16,Jin Yinghui17,Sun Feng18,Meng Wenbo19,Li Guobao20,Wu Qijun21,Chen Ze1,Wang Xu22,Estill Janne12,Norris Susan L.23,Du Liang24,Chen Yaolong12526,Wei Junmin27

Affiliation:

1. Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu 730000, China;

2. Institute of Global Health, University of Geneva, Geneva 1202, Switzerland;

3. School of Public Health, Lanzhou University, Lanzhou, Gansu 730000, China;

4. Editor-in-Chief Office, Chinese Medical Association Publishing House, Beijing 100052, China;

5. Marketing Department, Chinese Medical Association Publishing House, Beijing 100052, China;

6. Editorial Department, National Medical Journal of China, Chinese Medical Association Publishing House, Beijing 100052, China;

7. Editorial Department, Chinese Medical Journal, Chinese Medical Association Publishing House, Beijing 100052, China;

8. Division of Infectious Diseases, Department of Internal Medicine, State Key Laboratory of Complex Severe and Rare Disease, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100730, China;

9. Editorial office of Digital Medicine and Health, Chinese Medical Association Publishing House, Beijing 100052, China;

10. Department of Hematology, Huashan Hospital, Fudan University, Shanghai 200040, China;

11. Evidence-based Medicine Center, Fudan University, Shanghai 200032, China;

12. Department of Hepatic Oncology, Xiamen Clinical Research Center for Cancer Therapy, Zhongshan Hospital (Xiamen), Fudan University, Xiamen, Fujian 361015, China;

13. Department of Obstetrics, Xiangya Hospital, Central South University, Changsha, Hunan 410008, China;

14. Department of Nephrology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Pediatrics, Chongqing 400014, China;

15. SMU Institute for Global Health (SIGHT), School of Health Management and Dermatology Hospital, Southern Medical University (SMU), Guangzhou, Guangdong 510515, China;

16. Department of Dermatology, The First Hospital of China Medical University, Shenyang, Liaoning 110001, China;

17. Center for Evidence-Based and Translational Medicine, Zhongnan Hospital of Wuhan University, Wuhan, Hubei 430071, China;

18. School of Public Health, Peking University, Beijing 100191, China;

19. Department of General Surgery, The First Hospital of Lanzhou University, Lanzhou, Gansu 730000, China;

20. Department of Lung Disease, Shenzhen Third People's Hospital, The Second Affiliated Hospital, Southern University of Science and Technology, Shenzhen, Guangdong 518112, China;

21. Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning 110004, China;

22. Chevidence Lab of Child and Adolescent Health, Children's Hospital of Chongqing Medical University, Chongqing 400014, China;

23. Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon 97239, USA;

24. Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China;

25. Research Unit of Evidence-Based Evaluation and Guidelines (2021RU017), Chinese Academy of Medical Sciences, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu 730000, China;

26. Guidelines and Standards Research Center, Chinese Medical Association Publishing House, Beijing 100052, China;

27. Chinese Medical Association Publishing House, Beijing 100052, China.

Abstract

Abstract Background: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability. Methods: This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability. Results: STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min. Conclusion: The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines.

Publisher

Ovid Technologies (Wolters Kluwer Health)

Subject

General Medicine,General Medicine

Reference35 articles.

1. Effect of clinical guidelines on medical practice: A systematic review of rigorous evaluations;Grimshaw;Lancet,1993

2. Achieving health gain through clinical guidelines. I: Developing scientifically valid guidelines;Grimshaw;Qual Health Care,1993

3. Are clinical practice guidelines valid for primary care?;Graham;J Clin Epidemiol,2000

4. Survey and evaluation of clinical practice guidelines in China in 2019;Yang;Med J PUMCH,2021

5. Clinical practice guidelines in China;Chen;BMJ,2018

Cited by 1 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3