Affiliation:
1. Department of Neuroscience, Fribourg University, 1700 Fribourg, Switzerland julien.audiffren@unifr.ch
2. Department of Neuroscience, Fribourg University, 1700 Fribourg, Switzerland jean-pierre.bresciani@unifr.ch
Abstract
Abstract
The quantification of human perception through the study of psychometric functions Ψ is one of the pillars of experimental psychophysics. In particular, the evaluation of the threshold is at the heart of many neuroscience and cognitive psychology studies, and a wide range of adaptive procedures has been developed to improve its estimation. However, these procedures are often implicitly based on different mathematical assumptions on the psychometric function, and unfortunately, these assumptions cannot always be validated prior to data collection. This raises questions about the accuracy of the estimator produced using the different procedures. In the study we examine in this letter, we compare five adaptive procedures commonly used in psychophysics to estimate the threshold: Dichotomous Optimistic Search (DOS), Staircase, PsiMethod, Gaussian Processes, and QuestPlus. These procedures range from model-based methods, such as the PsiMethod, which relies on strong assumptions regarding the shape of Ψ, to model-free methods, such as DOS, for which assumptions are minimal. The comparisons are performed using simulations of multiple experiments, with psychometric functions of various complexity. The results show that while model-based methods perform well when Ψ is an ideal psychometric function, model-free methods rapidly outshine them when Ψ deviates from this model, as, for instance, when Ψ is a beta cumulative distribution function. Our results highlight the importance of carefully choosing the most appropriate method depending on the context.
Subject
Cognitive Neuroscience,Arts and Humanities (miscellaneous)
Reference35 articles.
1. Dichotomous optimistic search to quantify human perception.;Audiffren;Proceedings of the 38th International Conference on Machine Learning,2021
2. Quantifying human perception with multi-armed bandits.;Audiffren;Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems,2021
3. Thresholds for the perception of whole body angular movement about a vertical axis;Benson;Aviation, Space, and Environmental Medicine,1989
4. Additional rules for the transformed up-down method in psychophysics;Brown;Perception and Psychophysics,1996
5. PAC identification of a bandit arm relative to a reward quantile.;Chaudhuri;Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence,2017