Affiliation:
1. Cyprus University of Technology, Limassol, Cyprus
2. UCLan Cyprus, Pyla, Cyprus
Abstract
ABSTRACT
This study examines the use of audiovisual cues in the perception of sound contrasts which have a different phonemic status in the listeners’ L1 and L2. Voice-voiceless cognates differing in the distinctiveness of their visual gestures (/p/-/b/, /t/-/d/, and /k/-/g/) were presented to CG (Cypriot-Greek) learners of English in audio, visual, and audiovisual modalities. Overall identification rates were significantly higher audiovisually in the cases where the auditory and visual information matched (bimodal congruent condition) than in the audiovisual condition in which auditory and visual information did not match (bimodal incongruent condition) or in the audio or video alone condition for either contrast. The results point to the multisensory speech-specific mode of perception, which plays an important role in alleviating the majority of moderate-to-severe L2 difficulties. CG listeners’ success seems to depend upon the ability to relate what they see to what they hear.
Reference18 articles.
1. Phoneme-to-viseme Mapping for Visual Speech Recognition;Cappelletta;Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods,2012
2. Long-term training, transfer, and retention in learning to lipread;Massaro;Percept Psychophys,1993
3. Recent advances in the automatic recognition of audio-visual speech;Potamianos;Proc IEEE,2003
4. The effect of experience on adults’ acquisition of a second language;Flege;Stud Second Lang Acquis,2001
5. A perceptual interference account of acquisition difficulties for non-native phonemes;Iverson;Cognition,2003