Author:
Ye Shangyuan,Li Daniel,Yu Tingting,Caroff Daniel A.,Guy Jeffrey,Poland Russell E.,Sands Kenneth E.,Septimus Edward J.,Huang Susan S.,Platt Richard,Wang Rui
Abstract
AbstractThe Centers for Medicare and Medicaid Services require hospitals to report on quality metrics which are used to financially penalize those that perform in the lowest quartile. Surgical site infections (SSIs) are a critical component of the quality metrics that target healthcare-associated infections. However, the accuracy of such hospital profiling is highly affected by small surgical volumes which lead to a large amount of uncertainty in estimating standardized hospital-specific infection rates. Currently, hospitals with less than one expected SSI are excluded from rankings, but the effectiveness of this exclusion criterion is unknown. Tools that can quantify the classification accuracy and can determine the minimal surgical volume required for a desired level of accuracy are lacking. We investigate the effect of surgical volume on the accuracy of identifying poorly performing hospitals based on the standardized infection ratio and develop simulation-based algorithms for quantifying the classification accuracy. We apply our proposed method to data from HCA Healthcare (2014–2016) on SSIs in colon surgery patients. We estimate that for a procedure like colon surgery with an overall SSI rate of 3%, to rank hospitals in the HCA colon SSI dataset, hospitals that perform less than 200 procedures have a greater than 10% chance of being incorrectly assigned to the worst performing quartile. Minimum surgical volumes and predicted events criteria are required to make evaluating hospitals reliable, and these criteria vary by overall prevalence and between-hospital variability.
Funder
Agency for Healthcare Research and Quality
Publisher
Springer Science and Business Media LLC
Reference26 articles.
1. Centers for Medicare and Medicaid Services. Hospital-acquired condition reduction program (hacrp) - centers for medicare & medicaid services. https://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/AcuteInpatientPPS/HAC-Reduction-Program.html (2020).
2. Soltoff, S., Koenig, L., Demehin, A. A., Foster, N. E. & Vaz, C. Identifying poor-performing hospitals in the medicare hospital-acquired condition reduction program: An assessment of reliability. J. Healthc. Qual. JHQ 40, 377–383 (2018).
3. Centers for Disease Control and Prevention. The nhsn standardized infection ratio (sir): A guide to the sir. https://www.cdc.gov/nhsn/pdfs/ps-analysis-resources/nhsn-sir-guide.pdf (2019).
4. Ash, A. S. et al. Statistical issues in assessing hospital performance commissioned by the committee of presidents of statistical societies the copss-cms white paper committee. Report (2011).
5. Normand, S.-L.T. et al. League tables for hospital comparisons. Annu. Rev. Stat. Appl. 3, 21–50 (2016).
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献