When Group Means Fail: Can One Size Fit All?

Abstract

AbstractThe present study examined whether a cognitive process model that is inferred based on group data holds, and is meaningful, at the level of the individual person. Investigation of this issue is tantamount to questioning that the same set and configuration of cognitive processes is present within all individuals, a usually untested assumption in standard group-based experiments. Search from memory as assessed with the Sternberg memory scanning paradigm is among the most widely studied phenomena in cognitive psychology. According to the original memory scanning model, search is serial and exhaustive. Here we critically examined the validity of this model across individuals and practice. 32 younger adults completed 1488 trials of the Sternberg task distributed over eight sessions. In the first session, group data followed the pattern predicted by the original model, replicating earlier findings. However, data from the first session were not sufficiently reliable for identifying whether each individual complied with the serial exhaustive search model. In sessions six to eight, when participants performed near asymptotic levels of performance, between-person differences were reliable, group data deviated substantially from the original memory search model, and the model fit only 13 of the 32 participants’ data. Our findings challenge the proposition that one general memory search process exists within a group of healthy younger adults, and questions the testability of this proposition at the individual level in single-session experiments. Implications for cognitive psychology and cognitive neuroscience are discussed with reference to earlier work emphasizing the explicit consideration of potentially existent individual differences.Author NoteThis study was conducted within the project “Cognitive and Neural Dynamics of Memory Across the Lifespan (CONMEM) ” at the Max Planck Institute for Human Development, Berlin, Germany. The work was supported by the Max Planck Society and the Gottfried Wilhelm Leibniz Prize 2011 of the German Research Foundation awarded to UL. MW-B’s work is supported by a grant from the German Research Foundation (DFG, WE 4269/3-1) as well as an Early Career Research Fellowship 2017 – 2019 awarded by the Jacobs Foundation.We thank Lene-Marie Gassner and all research assistants involved in data collection.