Author:
Wang Meiqi,Qiao Kangyu,Xing Shuyue,Yuan Caixia,Wang Xiaojie
Abstract
AbstractDocument information selection is an essential part of document-grounded dialogue tasks, and more accurate information selection results can provide more appropriate dialogue responses. Existing works have achieved excellent results by employing multi-granularity of dialogue history information, indicating the effectiveness of multi-level historical information. However, these works often focus on exploring the hierarchical information of dialogue history, while neglecting the multi-granularity utilization in response, important information that holds an impact on the decoding process. Therefore, this paper proposes a model for document information selection based on multi-granularity responses. By integrating the document selection results at the response word level and semantic unit level, the model enhances its capability in knowledge selection and produces better responses. For the division at the semantic unit level of the response, we propose two semantic unit division methods, static and dynamic. Experiments on two public datasets show that our models combining static or dynamic semantic unit levels significantly outperform baseline models.
Publisher
Springer Science and Business Media LLC
Reference41 articles.
1. Ma L, Zhang W, Li M, Liu T (2020) A survey of document grounded dialogue systems (DGDS). CoRR. abs/2004.13818
2. Feng S, Patel SS, Wan H, Joshi S (2021) Multidoc2dial: modeling dialogues grounded in multiple documents. In: Moens M, Huang X, Specia L, Yih SW (eds) Proceedings of the 2021 conference on empirical methods in natural language processing, EMNLP 2021, Virtual Event/Punta Cana, Dominican Republic, 7–11 Nov 2021, pp 6162–6176. 10.18653/v1/2021.emnlp-main.498
3. Gu J, Ling Z, Liu Q, Chen Z, Zhu X (2020) Filtering before iteratively referring for knowledge-grounded response selection in retrieval-based chatbots. In: Cohn T, He Y, Liu Y (eds) Findings of the association for computational linguistics: EMNLP 2020, Online Event, 16–20 Nov 2020. Findings of ACL, vol EMNLP 2020, pp 1412–1422. 10.18653/v1/2020.findings-emnlp.127
4. Zhang Y, Ren P, de Rijke M (2019) Improving background based conversation with context-aware knowledge pre-selection. CoRR abs/1906.06685
5. Zhang Y, Fu H, Fu C, Yu H, Li Y, Nguyen C (2023) Coarse-to-fine knowledge selection for document grounded dialogs, vol abs/2302.11849. https://doi.org/10.48550/arXiv.2302.11849