Reliability of Radiologic Assessments of Clinically Relevant Growth Remaining in Knee MRI of Children and Adolescents With Patellofemoral Instability: Data From the JUPITER Cohort

Abstract

Background: Surgical decision making and preoperative planning for children and adolescents with patellofemoral instability rely heavily on a patient’s skeletal maturity. To be clinically useful, radiologic assessments of skeletal maturity must demonstrate acceptable interrater reliability and accuracy. Purpose: The purpose of this study was to examine the interrater reliability among surgeons of varying experience levels and specialty training backgrounds when evaluating the skeletal maturity of the distal femur and proximal tibia of children and adolescents with patellofemoral instability. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: Six fellowship-trained orthopaedic surgeons (3 pediatric orthopaedic, 2 sports medicine, and 1 with both) who perform a high volume of patellofemoral instability surgery examined 20 blinded knee radiographs and magnetic resonance images in random order. They assessed these images for clinically relevant growth (open physis) or clinically insignificant growth (closing/closed physis) remaining in the distal femoral and proximal tibial physes. Fleiss’ kappa was calculated for each measurement. After initial ratings, raters discussed consensus methods to improve reliability and assessed the images again to determine if training and new criteria improved interrater reliability. Results: Reliability for initial assessments of distal femoral and proximal tibial physeal patency was poor (kappa range, 0.01-0.58). After consensus building, all assessments demonstrated almost-perfect interrater reliability (kappa, 0.99 for all measurements). Conclusion: Surgical decision making and preoperative planning for children and adolescents with patellofemoral instability rely heavily on radiologic assessment of skeletal maturity. This study found that initial interrater reliability of physeal patency and clinical decision making was unacceptably low. However, with the addition of new criteria, a consensus-building process, and training, these variables became highly reliable.