Investigation into the intersection between response process validity and answer-until-correct validity: development of the repeated attempt processing issue detection (RAPID) method-Reference-Cited by-同舟云学术

Investigation into the intersection between response process validity and answer-until-correct validity: development of the repeated attempt processing issue detection (RAPID) method

Published:2024 Issue: Volume: Page:
ISSN:1109-4028
Container-title:Chemistry Education Research and Practice
language:en
Short-container-title:Chem. Educ. Res. Pract.

Author:

Schreurs David G.¹^ORCID,Trate Jaclyn M.²^ORCID,Srinivasan Shalini³,Teichert Melonie A.⁴^ORCID,Luxford Cynthia J.⁵^ORCID,Schneider Jamie L.⁶^ORCID,Murphy Kristen L.¹^ORCID

Affiliation:

1. University of Wisconsin-Milwaukee, Milwaukee, Wisconsin 53211, USA

2. University of Wisconsin-Madison, Madison, Wisconsin 53706, USA

3. Metropolitan State University of Denver, Denver, Colorado 80204, USA

4. United States Naval Academy, Annapolis, Maryland 21402, USA

5. Texas State University, San Marcos, Texas 78666, USA

6. University of Wisconsin-River Falls, River Falls, Wisconsin 54022, USA

Abstract

With the already widespread nature of multiple-choice assessments and the increasing popularity of answer-until-correct, it is important to have methods available for exploring the validity of these types of assessments as they are developed. This work analyzes a 20-question multiple choice assessment covering introductory undergraduate chemistry topics which was given to students in an answer-until-correct manner. Response process validity was investigated through one-on-one think-aloud interviews with undergraduate chemistry students. Answer-until-correct validity was also explored using an analysis of partial credit assignments. Results indicated the convenience of the quantitative partial credit method came at great cost to the precision of validity issue detection and is therefore not a valid shortcut to more rich qualitative approaches. The repeated attempt processing issue detection (RAPID) method is a novel method developed as a combination of response process and answer-until-correct validity. Results from this new method revealed validity issues that were undetected from the use of either approach individually or in concert.

Funder

Division of Undergraduate Education

Publisher

Royal Society of Chemistry (RSC)

Subject

Education,Chemistry (miscellaneous)

Link

http://pubs.rsc.org/en/content/articlepdf/2024/RP/D3RP00204G

Reference43 articles.

1. 2005 General Chemistry Exam – Paired Questions, First Term | ACS Exams

2. 2008 General Chemistry Conceptual Exam – Full Year, First Term and Second Term | ACS Exams

3. Adams W. K., Wieman C. E., Perkins K. K. and Barbera J., (2008), Modifying and Validating the Colorado Learning Attitudes about Science Survey for Use in Chemistry, J. Chem. Educ. , 85 (10), 1435 10.1021/ed085p1435

4. American Educational Research Association, (1999), Standards for educational and psychological testing , American Educational Research Association

5. Arjoon J. A., Xu X. and Lewis J. E., (2013), Understanding the State of the Art for Measurement in Chemistry Education Research: Examining the Psychometric Evidence, J. Chem. Educ. , 90 (5), 536–545 10.1021/ed3002013