Affiliation:
1. University of Regensburg, Bavaria, Germany
Abstract
As conversational search becomes more pervasive, it becomes increasingly important to understand the users’ underlying information needs when they converse with such systems in diverse domains. We conduct an in situ study to understand information needs arising in a home cooking context as well as how they are verbally communicated to an assistant. A human experimenter plays this role in our study. Based on the transcriptions of utterances, we derive a detailed hierarchical taxonomy of diverse information needs occurring in this context, which require different levels of assistance to be solved. The taxonomy shows that needs can be communicated through different linguistic means and require different amounts of context to be understood. In a second contribution, we perform classification experiments to determine the feasibility of predicting the type of information need a user has during a dialogue using the turn provided. For this multi-label classification problem, we achieve average F1 measures of 40% using BERT-based models. We demonstrate with examples which types of needs are difficult to predict and show why, concluding that models need to include more context information in order to improve both information need classification and assistance to make such systems usable.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Science Applications,General Business, Management and Accounting,Information Systems
Reference103 articles.
1. User Intent Inference for Web Search and Conversational Agents
2. Contextual Dialogue Act Classification for Open-Domain Conversational Agents
3. Alan Akbik Tanja Bergmann Duncan Blythe Kashif Rasul Stefan Schweter and Roland Vollgraf. 2019. FLAIR: An easy-to-use framework for state-of-the-art NLP. In Annual Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations) Minneapolis Minnesota . 54–59.
4. Harnessing Evolution of Multi-Turn Conversations for Effective Answer Retrieval
5. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献