Affiliation:
1. School of Business, Guilin University of Electronic Technology, Guilin 541004, China
Abstract
Aiming at addressing the inability of traditional web technologies to effectively respond to Winter-Olympics-related user questions containing multiple intentions, this paper explores a multi-model fusion-based multi-intention recognition model BCNBLMATT to solve this problem. The model is proposed to address the characteristics of complex semantics, strong contextual relevance, and a large number of informative features of the Chinese problem text related to the Winter Olympics, as well as the limitations of the traditional word vector model, such as insufficient expression in the textual representation and the relative concern mechanism of feature expression. The BCNBLMATT model first obtains a comprehensive feature vector representation of the problem text through BERT. Then, a multi-scale text convolutional neural network model and a BiLSTM-Multi-heads attention model (a joint model combining a bidirectional long- and short-term attention network with a multi-head attention mechanism) are used to capture local features at more scales and contextually critical information features at more levels. Finally, the two obtained kinds of features are concatenated and fused to obtain richer and more comprehensive information about the problem text features, which improves the model’s performance in the multi-attention recognition task. Comparative experiments on the Winter Olympics Chinese question dataset and the MixATIS question dataset show that the BCNBLMATT model significantly improves the three metrics of macro-averaged precision, macro-averaged recall, and macro-averaged F1 value and exhibits better generalization. This study provides an effective solution to the multi-intent recognition task for Winter Olympic problems, overcomes the limitations of traditional models, and provides new ideas for improving the performance of multi-intent recognition.
Funder
national key research and development program of China
National Natural Science Foundation
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference30 articles.
1. Winter Olympic Q & A system based on knowledge map, TF-IDF and BERT model;Luo;CAAI Trans. Intell. Syst.,2021
2. Xu, P.Y., and Sarikaya, R. (2013, January 25–29). Exploiting shared information for multiintent natural language sentence classification. Proceedings of the 14th Annual Conference of the International Speech Communication Association, Lyon, France.
3. Two-stage multi-intent detection for spoken language understanding;Kim;Multimed. Tools Appl.,2017
4. Multi-intention recognition model with combination of syntactic feature and convolution neural network;Yang;J. Comput. Appl.,2018
5. Research of short text multi-intent detection with capsule network;Liu;J. Front. Comput. Sci. Technol.,2020