Measures of interrater agreement for quantitative data-Reference-Cited by-同舟云学术

Measures of interrater agreement for quantitative data

Published:2023-10-10 Issue: Volume: Page:
ISSN:1863-8171
Container-title:AStA Advances in Statistical Analysis
language:en
Short-container-title:AStA Adv Stat Anal

Author:

Marella Daniela,Bove Giuseppe

Abstract

AbstractIn this paper measures of interrater absolute agreement for quantitative measurements based on the standard deviation are proposed. Such indices allow (i) to overcome the limits affecting the intraclass correlation index; (ii) to measure the interrater agreement on single targets. Estimators of the proposed measures are introduced and their sampling properties are investigated for normal and non-normal data. Simulated data are employed to demonstrate the accuracy and practical utility of the new indices for assessing agreement. Finally, an application to assess the consistency of measurements performed by radiologists evaluating tumor size of lung cancer is presented.

Funder

Università degli Studi di Roma La Sapienza

Publisher

Springer Science and Business Media LLC

Subject

Applied Mathematics,Economics and Econometrics,Social Sciences (miscellaneous),Modeling and Simulation,Statistics and Probability,Analysis

Link

https://link.springer.com/content/pdf/10.1007/s10182-023-00483-x.pdf

Reference22 articles.

1. Atenafu, E.G., Hamid, J.S., To, T., Willan, A., Feldman, B., Beyene, J.: Bias-corrected estimator for the intraclass correlation coefficient in the balanced one-way random effects model. BMC Med. Res. Methodol. 12(126), 110 (2012)

2. Bove, G., Conti, P.L., Marella, D.: A measure of interrater absolute agreement for ordinal categorical data. Stat. Methods Appl. 30, 927–945 (2021)

3. Bove, G.: Measures of interrater agreement based on the standard deviation. In: Balzanella, A., Bini, M., Cavicchia, C., Verde, R. (eds.) 51st Scientific Meeting of the Italian Statistical Society (SIS), Book of short papers, pp. 1644–1649. Pearson, Milano. ISBN 9788891932310 (2022)

4. Broemeling, L.D.: Bayesian Methods for Measures of Agreement. Chapman & Hall/CRC, London (2009)

5. Conti, P.L., Marella, D., Mecatti, F., Andreis, F.: A unified principled framework for resampling based on pseudo-populations: asymptotic theory. Bernoulli 26(2), 1044–1069 (2020)