Assessing penmanship of Chinese handwriting: a deep learning-based approach

Abstract

AbstractThe rise of the digital era has led to a decline in handwriting as the primary mode of communication, resulting in negative effects on handwriting literacy, particularly in complex writing systems such as Chinese. The marginalization of handwriting has contributed to the deterioration of penmanship, defined as the ability to write aesthetically and legibly. Despite penmanship being widely acknowledged as a crucial factor in predicting language literacy, research on its evaluation remains limited, with existing assessments primarily dependent on expert subjective ratings. Recent initiatives have started to explore the application of convolutional neural networks (CNN) for automated penmanship assessment. In this study, we adopted a similar approach, developing a CNN-based automatic assessment system for penmanship in traditional Chinese handwriting. Utilizing an existing database of 39,207 accurately handwritten characters (penscripts) from 40 handwriters, we had three human raters evaluate each penscript’s penmanship on a 10-point scale and calculated an average penmanship score. We trained a CNN on 90% of the penscripts and their corresponding penmanship scores. Upon testing the CNN model on the remaining 10% of penscripts, it achieved a remarkable performance (overall 9.82% normalized Mean Absolute Percentage Error) in predicting human penmanship scores, illustrating its potential for assessing handwriters’ penmanship. To enhance accessibility, we developed a mobile application based on the CNN model, allowing users to conveniently evaluate their penmanship.