Automatic evaluation-feedback system for automated social skills training
-
Published:2023-04-26
Issue:1
Volume:13
Page:
-
ISSN:2045-2322
-
Container-title:Scientific Reports
-
language:en
-
Short-container-title:Sci Rep
Author:
Saga Takeshi,Tanaka Hiroki,Matsuda Yasuhiro,Morimoto Tsubasa,Uratani Mitsuhiro,Okazaki Kosuke,Fujimoto Yuichiro,Nakamura Satoshi
Abstract
AbstractSocial skills training (SST), which is a rehabilitation program for improving daily interpersonal communication, has been used for more than 40 years. Although such training’s demand is increasing, its accessibility is limited due to the lack of experienced trainers. To tackle this issue, automated SST systems have been studied for years. An evaluation-feedback pipeline of social skills is a crucial component of an SST system. Unfortunately, research that considers both the evaluation and feedback parts of automation remains insufficient. In this paper, we collected and analyzed the characteristics of a human–human SST dataset that consisted of 19 healthy controls, 15 schizophreniacs, 16 autism spectrum disorder (ASD) participants, and 276 sessions with score labels of six clinical measures. From our analysis of this dataset, we developed an automated SST evaluation-feedback system under the supervision of professional, experienced SST trainers. We identified their preferred or most acceptable feedback methods by running a user-study on the following conditions: with/without recorded video of the role-plays of users and different amounts of positive and corrective feedback. We confirmed a reasonable performance of our social-skill-score estimation models as our system’s evaluation part with a maximum Spearman’s correlation coefficient of 0.68. For the feedback part, our user-study concluded that people understood more about what aspects they need to improve by watching recorded videos of their own performance. In terms of the amount of feedback, participants most preferred a 2-positive/1-corrective format. Since the average amount of feedback preferred by the participants nearly equaled that from experienced trainers in human–human SSTs, our result suggests the practical future possibilities of an automated evaluation-feedback system that complements SSTs done by professional trainers.
Funder
University fellowships toward the creation of science technology innovation Japan Society for the Promotion of Science Core Research for Evolutional Science and Technology
Publisher
Springer Science and Business Media LLC
Subject
Multidisciplinary
Reference46 articles.
1. Bellack, A. S., Mueser, K. T., Gingerich, S. & Agresta, J. Social Skills Training for Schizophrenia: A Step-by-Step Guide 2nd edn. (Guilford Press, 2004). 2. Hersen, M., Bellack, A. S. & Turner, S. M. Assessment of assertiveness in female psychiatric patients: Motor and autonomic measures. J. Behav. Ther. Exp. Psychiatry 9, 11–16. https://doi.org/10.1016/0005-7916(78)90081-2 (1978). 3. Bandura, A. Principles of Behavior Modification (Holt, Rinehart and Winston, 1969). 4. Hoque, M. E., Courgeon, M., Martin, J.-C., Mutlu, B. & Picard, R. W. Mach: My automated conversation coach. In UbiComp ’13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, UbiComp ’13, 697–706. https://doi.org/10.1145/2493432.2493502 (Association for Computing Machinery, New York, NY, USA, 2013). 5. Schneider, J., Börner, D., van Rosmalen, P. & Specht, M. Presentation trainer, your public speaking multimodal coach. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, ICMI ’15, 539–546. https://doi.org/10.1145/2818346.2830603 (Association for Computing Machinery, New York, NY, USA, 2015).
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. An Adaptive Virtual Agent Platform for Automated Social Skills Training;International Cconference on Multimodal Interaction;2023-10-09 2. Social Performance Rating During Social Skills Training in Adults with Autism Spectrum Disorder and Schizophrenia;2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW);2023-09-10
|
|