Affiliation:
1. Department of Urology University Hospitals Leuven Leuven Belgium
2. Division of Oncology, Unit of Urology Urological Research Institute, IRCCS Ospedale San Raffaele Milan Italy
3. Interuniversity Centre for Biostatistics and Statistical Bioinformatics Leuven Belgium
4. Leuven Institute for Healthcare Policy Leuven Belgium
Abstract
ObjectivesTo assess the intra/inter‐observer reliability of cystoscopic sphincter evaluation (CSE) in men undergoing sling surgery for urinary incontinence and if possible to evaluate its correlation with the final clinical decision.Patients and methodsTwo expert urologists prospectively filmed and recorded, incontinent patient's cystoscopies according to a standard scenario. Anonymised recordings where randomly offered to the same observer twice. The observers (medical students, urology residents and full urologist with 0–5, 5–10, >10 years of practice, respectively) were asked to assess and score the recordings without knowing any of the patients’ characteristics.ResultsIn total, 37 recordings were scored twice by the 26 observers. The intraclass correlation coefficient (ICC) for intra‐observer reliability of the CSE was 0.54 (moderate), 0.58 (moderate) and 0.60 (substantial) for medical students, residents, and urologists, respectively. However, when stratifying observers according to their experience, the lowest agreement values were found between experts with >10 years of experience. The inter‐observer reliability for the CSE ICCs ranged between 0.31and 0.53, with the lowest ICC value observed between urologists (0.31).ConclusionsThe study demonstrates poor intra‐ and inter‐observer reliability of the CSE. According to these results, a CSE does not add valuable information to the clinical evaluation. In this scenario, it should not be considered in isolation from the patient's characteristics.