Analysis of Backchannel Inviting Cues in Dyadic Speech Communication-Reference-Cited by-同舟云学术

Analysis of Backchannel Inviting Cues in Dyadic Speech Communication

Published:2023-09-01 Issue:17 Volume:12 Page:3705
ISSN:2079-9292
Container-title:Electronics
language:en
Short-container-title:Electronics

Author:

Ondáš Stanislav¹^ORCID,Kiktová Eva²^ORCID,Pleva Matúš¹^ORCID,Juhár Jozef¹^ORCID

Affiliation:

1. Department of Electronics and Multimedia Communications, Faculty of Electrical Engineering and Informatics, Technical University of Košice, Letna 9, 04200 Košice, Slovakia

2. Language, Information and Communication Laboratory, Pavol Jozef Šafárik University in Košice, Moyzesova 9, 04011 Košice, Slovakia

Abstract

The paper aims to study speaker and listener behavior in dyadic speech communication. A multimodal (speech and video) corpus of dyadic face-to-face conversations on various topics was created. The corpus was manually labeled on several layers (text transcription, backchannel modality and function, POS tags, prosody, and gaze). The statistical analysis was done on the proposed corpus. We focused on backchannel inviting cues on the speaker side and backchannels on the listener side and their patterns. We aimed to study interlocutor backchannel behavior and backchannel-related signals. The results of the analysis show similar patterns in the case of backchannel inviting cues between Slovak and English data and highlight the importance of gaze direction in a face-to-face speech communication scenario. The described corpus and results of the analysis are one of the first steps leading towards natural artificial intelligence-driven human–computer speech conversation.

Funder

Slovak Research and Development Agency

Scientific Grant Agency of the Ministry of Education, Science, Research and Sport of the Slovak Republic, and the Slovak Academy of Sciences

Publisher

MDPI AG

Subject

Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering

Link

https://www.mdpi.com/2079-9292/12/17/3705/pdf

Reference30 articles.

1. Some signals and rules for taking speaking turns in conversations;Duncan;J. Personal. Soc. Psychol.,1972

2. Gravano, A., and Hirschberg, J. (2009, January 11–12). Backchannel-inviting cues in task-oriented dialogue. Proceedings of the SigDial, London, UK.

3. Benus, S. (June, January 31). The prosody of backchannels in Slovak. Proceedings of the 8th International Conference on Speech Prosody, Boston, MA, USA.

4. Hjalmarsson, A., and Oertel, C. (2012, January 12–14). Gaze direction as a back-channel inviting cue in dialogue. Proceedings of the IVA 2012 Workshop on Realtime Conversational Virtual Agents, Santa Cruz, CA, USA.

5. Ondáš, S., Kiktová, E., and Pleva, M. (2022, January 21–22). Slovak dialogue corpus with backchannel annotation. Proceedings of the 2022 32nd International Conference Radioelektronika, Kosice, Slovakia.