Affiliation:
1. Cognitive Function Clinic, Walton Center for Neurology & Neurosurgery, Lower Lane, Fazakerley, Liverpool, L9 7LJ, UK
Abstract
Aim: To examine four different accuracy metrics for assessment of commonly used cognitive screening instruments: correct classification accuracy, area under the receiver operating characteristic curve, F measure (F) or F1 score and Matthews correlation coefficient (MCC). Methods: Raw data were extracted from test accuracy studies of Mini-Mental State Examination. Montreal Cognitive Assessment, Mini-Addenbrooke's Cognitive Examination, Six-item Cognitive Impairment Test, informant AD8 and Free-Cog, and used to calculate the accuracy measures. Results: Each metric resulted in similar ordering of the screening instruments for diagnosis of both dementia and mild cognitive impairment. Area under the receiver operating characteristic curve gave the highest (most optimistic) and MCC the lowest (most pessimistic) accuracy value for each test examined, with correct classification accuracy and F falling between. Conclusion: All the accuracy measures examined have potential shortcomings. None can be recommended as the definitive unitary outcome measure for test accuracy studies. However, MCC has theoretical advantages and might be more widely adopted.
Cited by
16 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Unitary Measures;The 2x2 Matrix;2024
2. Paired Complementary Measures;The 2x2 Matrix;2024
3. Classification of Metrics of Binary Classification;The 2x2 Matrix;2024
4. Graphing Methods;The 2x2 Matrix;2024
5. Categorical Boosting Machine for Tamil Character Recognition Using Shape Based Features;2023 7th International Conference On Computing, Communication, Control And Automation (ICCUBEA);2023-08-18