Abstract
This chapter describes the work of creating multimodal open-access online Delphi studies (OAODS). These are electronic Delphi studies that do not begin with an invited group of identified experts to seat a Delphi panel but rather with self-identified domain-specific authorities active on the Social Web, with post-data-collection vetting of the participants (when knowable) and their responses. This chapter explores how to design such instruments with efficacy and nuance, and built-in tests of respondent expertise, and fraud detection, and further, how to test such instruments for efficacy, reliability, and validity, while using some of the latest features available in online survey research platforms. The platform used in this work is the Qualtrics Research Suite.
Reference67 articles.
1. Real-Time Delphi in practice — A comparative analysis of existing software-based tools
2. Electronic survey methodology: A case study in reaching hard-to-involve Internet users.;D.Andrews;International Journal of Human-Computer Interaction,2010
3. Benton, M. C., Pappas, J., & Pappas, E. (2011). WordPress+Qualtrics: A plugin supporting research and new pedagogy to develop personal sustainability via 360o evaluation. In Proceedings of 17th Americas Conference on Information Systems (AMCIS 2011). Association for Information Systems AIS Electronic Library. Retrieved from https://aisel.aisnet.org/cgi/viewcontent.cgi?referer=https://www.google.com/&httpsredir=1&article=1129&context=amcis2011_submissions
4. Improving the Delphi process: Lessons from social psychological research
5. Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review