Abstract
AbstractSpeech comprehension involves the dynamic interplay of multiple cognitive processes, from basic sound perception, to linguistic encoding, and finally to complex semantic-conceptual interpretations. How the brain handles the diverse streams of information processing remains poorly understood. Applying Hidden Markov Modeling to fMRI data obtained during spoken narrative comprehension, we reveal that the whole brain networks predominantly oscillate within a tripartite latent state space. These states are respectively characterized by high activities in the sensory-motor (State #1), bilateral temporal (State #2), and DMN (State #3) regions, with State #2 acting as a transitional hub. The three states are selectively modulated by the acoustic, word-level semantic and clause-level semantic properties of the narrative. Moreover, the alignment with the best performer in brain state expression can predict participants’ narrative comprehension scores. These results are reproducible with different brain network atlas and generalizable to two independent datasets consisting of young and older adults. Our study suggests that the brain underlies narrative comprehension by switching through a tripartite state space, with each state probably dedicated to a specific component of language faculty, and effective narrative comprehension relies on engaging those states in a timely manner.
Publisher
Cold Spring Harbor Laboratory
Reference33 articles.
1. Discovering event structure in continuous narrative perception and memory;Neuron,2017
2. Ballenghein, U. , Megalakaki, O. , & Baccino, T. (2019). Cognitive engagement in emotional text reading: concurrent recordings of eye movements and head motion. Cognition and Emotion.
3. Evolution, brain, and the nature of language
4. Large-scale brain networks in cognition: emerging methods and principles
5. Pre-training with whole word masking for chinese bert. IEEE/ACM Transactions on Audio;Speech, and Language Processing,2021