Effector-dependent response deterioration by stochastic transformations reveals mixed reference frames for decisions

Abstract

AbstractRecent psychophysical and modeling studies have revealed that sensorimotor reference frame transformations (RFTs) add variability to motor output by decreasing the fidelity of sensory signals. How RFT stochasticity affects the sensory input underlying perceptual decisions, if at all, is unknown. To investigate this, we asked participants to perform a simple two-alternative motion direction discrimination task under varying conditions of head roll and/or stimulus rotation while responding either with a saccade or button press, allowing us to attribute behavioral effects to eye-, head- and shoulder-centered reference frames. We observed a rotation-induced, increase in reaction time and decrease in accuracy, indicating a degradation of motion evidence commensurate with a decrease in motion strength. Inter-participant differences in performance were best explained by a continuum of eye-head-shoulder representations of accumulated decision evidence, with eye- and shoulder-centered preferences during saccades and button presses, respectively. We argue that perceptual decision making and stochastic RFTs are inseparable, consistent with electrophysiological recordings in neural areas thought to be encoding sensorimotor signals for perceptual decisions. Furthermore, transformational stochasticity appears to be a generalized phenomenon, applicable throughout the perceptual and motor systems. We show for the first time that, by simply rolling one’s head, perceptual decision making is impaired in a way that is captured by stochastic RFTs.Significance statementWhen exploring our environment, we typically maintain upright head orientations, often even despite increased energy expenditure. One possible explanation for this apparently suboptimal behavior might come from the finding that sensorimotor transformations, required for generating geometrically-correct behavior, add signal- dependent variability (stochasticity) to perception and action. Here, we explore the functional interaction of stochastic transformations and perceptual decisions by rolling the head and/or stimulus during a motion direction discrimination task. We find that, during visuomotor rotations, perceptual decisions are significantly impaired in both speed and accuracy in a way that is captured by stochastic transformations. Thus, our findings suggest that keeping one’s head aligned with gravity is in fact ideal for making perceptual judgments about our environment.