On the Reliability of User Feedback for Evaluating the Quality of Conversational Agents-Reference-Cited by-同舟云学术

On the Reliability of User Feedback for Evaluating the Quality of Conversational Agents

Published:2023-10-21 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
language:
Short-container-title:

Author:

Massiah Jordan¹^ORCID,Yilmaz Emine¹^ORCID,Jiao Yunlong²^ORCID,Kazai Gabriella²^ORCID

Affiliation:

1. Amazon & University College London, London, United Kingdom

2. Amazon, London, United Kingdom

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3583780.3615286

Reference31 articles.

1. Beyond Customer Lifetime Valuation: Measuring the Value of Acquisition and Retention for Subscription Services

2. Relevance assessment

3. Praveen Kumar Bodigutla , Spyros Matsoukas , Longshaokan Marshall Wang , Kate Ridgeway, Joshua Levy, Swanand Joshi, and Alborz Geramifard. 2019 . Domain- independent turn-level dialogue quality evaluation via user satisfaction estimation. Praveen Kumar Bodigutla, Spyros Matsoukas, Longshaokan Marshall Wang, Kate Ridgeway, Joshua Levy, Swanand Joshi, and Alborz Geramifard. 2019. Domain- independent turn-level dialogue quality evaluation via user satisfaction estimation.

4. Joint Turn and Dialogue level User Satisfaction Estimation on Multi-Domain Conversations

5. Chris Buckley and Ellen M. Voorhees . 2000. Evaluating evaluation measure stability . In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '00 , page 33 -- 40 , New York, NY, USA. Association for Computing Machinery. Chris Buckley and Ellen M. Voorhees. 2000. Evaluating evaluation measure stability. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '00, page 33--40, New York, NY, USA. Association for Computing Machinery.