Interrater reliability of the ovarian–adnexal reporting and data system magnetic resonance imaging (O‑RADS MRI)

Abstract

Abstract Aim The current study aims to evaluate interrater reliability of ovarian–adnexal reporting and data system (O-RADS) magnetic resonance imaging (MRI) in interpretation of adnexal and ovarian lesions. Material and methods Retrospective analysis of 131 ovarian lesions was as done for 106 consecutive female patients with adnexal and/or ovarian lesions that underwent MR imaging of the pelvis. Images interpretation was accomplished by two-blinded independent raters for cystic and solid parts of ovarian lesions. The score was 5 types classified pursuant to O-RADS. Results A perfect interrater agreement regarding overall O-RADS [Kappa: 0.874, P: 0.001]. There was a perfect interrater agreement of the solid component (Kappa: 0.979, 95% confidence interval (CI) 0.938–1.0, P: 0.001), enhancement degree relative to myometrium (Kappa: 0.876, 95% CI 0.781–0.971, P: 0.001) and entirely solid lesions (Kappa: 1.0, 95% CI 1.0–1.0, P: 0.001). A perfect interrater agreement for ORADS 1 (Kappa: 0.937, P: 0.001), ORADS 2 (Kappa: 0.983, P: 0.001), ORADS 3 (Kappa: 0.834, P: 0.001), ORADS 4 (Kappa: 0.827, P: 0.001) and ORADS 5 (Kappa: 0.963, P: 0.001) was present. Conclusions The O-RADS MRI scoring system has better characterization of adnexal masses with high interrater agreement. Overcoming limitations of this study, O-RADS, may be suggested as a basic system in assessment of adnexal masses.