Affiliation:
1. Department of AI Convergence, Chonnam National University, Gwangju 61186, Republic of Korea
2. Department of Psychology, Chonnam National University, Gwangju 61186, Republic of Korea
Abstract
We present the Group Cohesion and Emotion (GCE) dataset, which comprises 1029 segmented films sourced from YouTube. These videos encompass a range of interactions, including interviews, meetings, informal discussions, and other similar contexts. In the annotation process, graduate psychology students were tasked with assigning coherence levels, ranging from 1 to 7, and affective states as negative, neutral, or positive for each 30 s film. We introduce a foundational model that utilizes advanced visual and audio embedding techniques to investigate the concepts of group cohesion and group emotion prediction. The application of Multi-Head Attention (MHA) fusion is utilized to enhance the process of cross-representation learning. The scope of our investigation includes both unimodal and multimodal techniques, which provide insights into the prediction of group cohesion and the detection of group emotion. The results emphasize the effectiveness of the GCE dataset in examining the level of group unity and emotional conditions.
Funder
National Research Foundation of Korea
Institute of Information and Communications Technology Planning and Evaluation (IITP) under the Artificial Intelligence Convergence Innovation Human Resources Development
Korean government (MSIT), and in part by the MSIT (Ministry of Science and ICT), Korea, under the Innovative Human Resource Development for Local Intellectualization support program
Reference33 articles.
1. The development of an instrument to assess cohesion in sport teams: The Group Environment Questionnaire;Carron;J. Sport Exerc. Psychol.,1985
2. Gruenfeld, D.H. (1998). Group Emotion: A View from Top and Bottom, Elsevier Science.
3. Constants across cultures in the face and emotion;Ekman;J. Personal. Soc. Psychol.,1971
4. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology;Posner;Dev. Psychopathol.,2005
5. Guo, D., Wang, K., Yang, J., Zhang, K., Peng, X., and Qiao, Y. (2019, January 14–18). Exploring regularizations with face, body and image cues for group cohesion prediction. Proceedings of the 2019 International Conference on Multimodal Interaction, Suzhou, China.