A psychological evaluation method incorporating noisy label correction mechanism

Abstract

AbstractUsing machine learning and deep learning methods to analyze text data from social media can effectively explore hidden emotional tendencies and evaluate the psychological state of social media account owners. However, the label noise caused by mislabeling may significantly influence the training and prediction results of traditional supervised models. To resolve this problem, this paper proposes a psychological evaluation method that incorporates a noisy label correction mechanism and designs an evaluation framework that consists of a primary classification model and a noisy label correction mechanism. Firstly, the social media text data are transformed into heterogeneous text graphs, and a classification model combining a pre-trained model with a graph neural network is constructed to extract semantic features and structural features, respectively. After that, the Gaussian mixture model is used to select the samples that are likely to be mislabeled. Then, soft labels are generated for them to enable noisy label correction without prior knowledge of the noise distribution information. Finally, the corrected and clean samples are composed into a new data set and re-input into the primary model for mental state classification. Results of experiments on three real data sets indicate that the proposed method outperforms current advanced models in classification accuracy and noise robustness under different noise ratio settings, and can efficiently explore the potential sentiment tendencies and users’ psychological states in social media text data.