Chapter 9. Multimodal story-retelling

Author:

Yang Cheng-Xiang1ORCID,Lin Yen-Liang1ORCID

Affiliation:

1. National Taipei University of Technology

Abstract

Cognitive load has been shown to influence speakers’ gesture production, but how it effects the duration, form, and functions of gestures is not yet well understood. This study examines how increased cognitive load influenced the production of co‑speech and co‑thought gestures by second language (L2) learners, and further looks at how different types of gestures correspond to specific functions. Twenty-four English as an L2 participants were recruited and required to watch a pre-determined cartoon and then retell the story in English. Participants were divided into two cognitive load conditions for the story retelling: one group was given a task structure for story retelling, while the other was not. The results of this study show that enhancing cognitive load significantly increased the frequency of both co‑speech and co‑thought gestures and the duration of co‑speech gestures, but not co‑thought gestures. With regard to the correspondence of gesture types and their functions for conceptualization (i.e., activation, manipulation, packaging, exploration), this study found co‑speech and co‑thought gestures serve different functions in L2 narrative tasks. Activation is dominant in every type of co‑speech gesture, especially in iconic and metaphoric gestures. Deictic gestures mostly function for packaging and exploration and co‑thought gestures for exploration and manipulation. This study provides necessary clarification on the relationship between cognitive load and gestures, including novel interactions of gesture duration and functions of gestures for conceptualization.

Publisher

John Benjamins Publishing Company

Reference49 articles.

1. Spontaneous Gestures Influence Strategy Choices in Problem Solving

2. Gesture and the process of speech production: We think, therefore we gesture

3. Gesture dynamics: Features sensitive to task difficulty and correlated with physiological sensors;Anthony;Stress,2011

4. Effects of multimedia task-based teaching and learning approach on EFL learners’ accuracy, fluency and complexity of oral production;Bava Harji;Turkish Online Journal of Educational Technology-TOJET,2017

5. Gesture and the transition from one- to two-word speech: when hand and mouth come together

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3