Affiliation:
1. Delft University of Technology, Delft, Netherlands
Abstract
Crowdsourcing marketplaces have provided a large number of opportunities for online workers to earn a living. To improve satisfaction and engagement of such workers, who are vital for the sustainability of the marketplaces, recent works have used conversational interfaces to support the execution of a variety of crowdsourcing tasks. The rationale behind using conversational interfaces stems from the potential engagement that conversation can stimulate. Prior works in psychology have also shown that conversational styles can play an important role in communication. There are unexplored opportunities to estimate a worker's conversational style with an end goal of improving worker satisfaction, engagement and quality. Addressing this knowledge gap, we investigate the role of conversational styles in conversational microtask crowdsourcing. To this end, we design a conversational interface which supports task execution, and we propose methods to estimate the conversational style of a worker. Our experimental setup was designed to empirically observe how conversational styles of workers relate with quality-related outcomes. Results show that even a naive supervised classifier can predict the conversation style with high accuracy (80%), and crowd workers with an Involvement conversational style provided a significantly higher output quality, exhibited a higher user engagement and perceived less cognitive task load in comparison to their counterparts. Our findings have important implications on task design with respect to improving worker performance and their engagement in microtask crowdsourcing.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. ContextBot;Proceedings of the 34th ACM Conference on Hypertext and Social Media;2023-09-04
2. CommunityBots: Creating and Evaluating A Multi-Agent Chatbot Platform for Public Input Elicitation;Proceedings of the ACM on Human-Computer Interaction;2023-04-14
3. DECI: A Tutorial on Designing Effective Conversational Interfaces;28th International Conference on Intelligent User Interfaces;2023-03-27
4. Crowdsourcing as a Future Collaborative Computing Paradigm;Wireless Networks;2023
5. Designing PairBuddy—A Conversational Agent for Pair Programming;ACM Transactions on Computer-Human Interaction;2022-05-05