A Multimodal Approach to Catalan Pragmatic Markers: An Exploratory Study

Abstract

This exploratory study aims to investigate the co-occurrence of Catalan pragmatic markers that fulfill an interactive function and multimodal cues, such as manual gestures, adaptors, head gestures, and eye gaze. To do so, we utilized spontaneous face-to-face conversations between ten different dyads, all of whom were undergraduate students discussing movies that they had recently seen. We processed the data with descriptive quantitative statistics, specifically employing exploratory multifactorial statistical visualization techniques, including multiple correspondence analysis (MCA) and cluster analysis. The results showed that pragmatic markers generally co-occur with multimodal cues. Although the multimodal system works independently, when pragmatic markers are uttered, both systems tend to harmonize in accordance with general communicative tasks, particularly turn management, alignment, and social affiliation.