Development of complexity categories for an investigational drug services complexity scoring tool to assess pharmacy effort in clinical trial initiation and maintenance

Abstract

Abstract Purpose Research pharmacy effort required to safely and compliantly manage investigational products (IP) varies between studies. No validated tool exists in the United States to evaluate these differences in effort. The Vizient Pharmacy Research Committee Investigational Drug Services (IDS) Subcommittee previously developed a systematic complexity scoring tool (CST) through expert consensus to assign a complexity score for pharmacy effort. This project seeks to develop and validate complexity categories based on CST scores. Methods Vizient member institutions in IDS assigned a CST complexity score and a perceived complexity category (low, medium, or high) for study initiation and maintenance. Receiver operating characteristic (ROC) curve analysis defined the best CST score cutoff points for each complexity category. Comparing the CST-assigned to the user-perceived complexity category determined whether the CST-assigned complexity category aligned with practitioner assignment. Results A total of 322 responses were used to determine complexity score categories. The AUC values for study initiation and maintenance were 0.79 (P < 0.001) for the low/medium boundary and 0.80 (P < 0.001) for the medium/high boundary, suggesting the performance of the CST is good. The agreement between CST-assigned and user-perceived complexity categories was 60% for study initiation and 58% for maintenance. The Kendall rank correlation coefficient between the raters and ROC categories was strong, with a value of 0.48 for study initiation and 0.47 for maintenance. Conclusion Development of the CST allows IDS pharmacies to objectively measure the complexity of clinical trials, which is a significant step towards assessing workload and guiding resource allocation.