Affectively Enhanced Subs-Reference-Cited by-同舟云学术

Affectively Enhanced Subs

Published:2020 Issue: Volume: Page:150-169
ISSN:2326-8905
Container-title:Advanced Technologies and Standards for Interactive Educational Television
language:
Short-container-title:

Author:

Margounakis Dimitrios G.¹^ORCID,Karamanos Andreas-Georgios²,Floros Andreas³^ORCID

Affiliation:

1. Aristotle University of Thessaloniki, Greece

2. Hellenic Open University, Greece

3. Ionian University, Greece

Abstract

This chapter presents the framework for a system that enhances the subtitles of a video file by detecting affective audio content. A model for the visualization of general and emotional information that is typically included in the audio material of a video file (TV/movies) is implemented. Depending on its nature, the content is visualized as an animated cartoon (sound assistant) and/or in the corresponding subtitle text channel, thereby supporting the monitoring of the above material in cases of hearing-impaired viewers, or in general cases that perception of sound during playback is problematic. An animated cartoon is proposed as a way of representing the emotional content of an audio event (speech) and the general content of an audio event (type of sound) in video, while color scales on the subtitles' fonts are used to represent basic emotions.

Publisher

IGI Global

Reference16 articles.

1. Conner-Simons, A., & Gordon, R. (2017). Wearable AI System can detect a Conversation’ s Tone. Retrieved from news.mit.edu/2017/wearable-ai-can-detect-tone-conversation-0201

2. Survey on speech emotion recognition: Features, classification schemes, and databases

3. Fels, D. I., Lee, D. G., Branje, C., & Hornburg, M. (2005). Emotive captioning and access to television. AMCIS 2005 Proceedings, 300.

4. Recognition of Practical Emotion from Elicited Speech

5. Joshi, D. D., & Zalte, M. B. (2013). Speech emotion recognition: a review. IOSR Journal of Electronics and Communication Engineering, 34-37.