Affiliation:
1. School of Fine Arts , Sichuan University of Science and Engineering , Zigong , Sichuan , , China .
Abstract
Abstract
Picture book creation has a rich metaphorical connotation, which is becoming more and more popular along with the development of digitalization. In this paper, the textual metaphors of picture book creation are extracted by combining the textual feature extraction model of the BERT pre-training model and HAN network, the ResNet50 network extracts the illustration metaphors of picture book creation, and the extracted metaphorical features are multimodal fused and recognized with the help of fully connected layer. In addition, a picture book metaphor dataset was constructed, and after analyzing the basic features of picture book metaphors, the effect of the constructed multimodal metaphor recognition was explored, and the recognition and communication of metaphors in picture book creation was studied. The results showed that the recognition accuracy in picture book creation ranged from 0.67 to 0.77, and the high degree of metaphor recognition in picture book creation showed a positive correlation with the average response time of communication, with the regression equation RT=138.45*IdentificationStd+1045.The results of the analysis of the metaphorical picture book creation pictures with textual references showed that the degree of communication comprehension (M=22.38. Std.=3.68), communication liking (M=94.86, Std.=13.58) and reaction time (M=82.44s, Std.=14.15s). Picture books facilitate better interactive communication through their metaphorical expression.
Reference12 articles.
1. Rajan, S. (2018). ‘the arts use a lot of psychology in designing the artistic experience’. The Psychologist.
2. Herold, K. (2020). An ecology of the russian avant-garde picturebook. by sara pankenier weld. amsterdam: john benjamins publishing company, 2018. xiv, 236 pp. bibliography. index. plates. $143.00, hard bound. Slavic Review, 79(2), 496-497.
3. Markland, A. J. (2018). The triumph of olemaun: survivance, empathic unsettlement, and restorying the history of canadian residential schools. International Research in Children s Literature, 11(2), 132-146.
4. Conrad, J. A. (2019). Modernity and modernism in twentieth-century american picturebooks. International Research in Children’s Literature, 12(2), 127-153.
5. Hui, H., & Zhang, Y. (2018). A reflection on current research on picture books and visual/verbal texts for young. History of Education and Children’s Literature, 13(1), 581-586.