Abstract
This essay presents the reflections of four Education Doctorate (EdD) students on the pilot testing strategies used during an online research methods course. Rigorous questionnaire and interview development skills are challenging to acquire. Pilot testing is an under-researched stage of instrument design, yet it is crucial to ensure validity and reliability, reduce bias, and psychologically prepare researchers for data collection. A structured, multi-step pilot testing process led to the collective development of stronger scholar-practitioner identities, the use of innovative synchronous/asynchronous methods during COVID-19 and increased academic rigor. These reflections demonstrate how several types of pilot testing can support the development of rigorous data collection instruments and prepare post-graduate students for the psychological and technical challenges they may encounter in future research.
Publisher
University Library System, University of Pittsburgh
Subject
Ocean Engineering,Safety, Risk, Reliability and Quality
Reference20 articles.
1. Acton, K. (2022). LHA3005: Introduction to Research Methods for the EdD. [Syllabus]. Toronto: Ontario Institute for Studies in Education.
2. Buss, R., Zambo, R., Zambo, D., & Williams, T. (2014). Developing research professionals in an EdD program: From learners and leaders to scholarly and influential practitioners. Higher Education, Skills and Work-Based Learning, 4(2), 137–160. https://doi.org/10.1108/HESWBL-11-2013-0022
3. Carnegie Project on the Education Doctorate. (2021). The CPED framework. https://www.cpedinitiative.org/the-framework
4. Castillo-Montoya, M. (2016). Preparing for interview research: The interview protocol refinement framework. The Qualitative Report, 21(5), 811–831. https://doi.org/10.46743/2160-3715/2016.2337
5. Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge.