The equation for medical multiple-choice question testing time estimation

Author:

Kreepala Chatchai1,Keeratibharat Nattawut2,Aekgawong Sekdusit2,Wattanavaekin Krittanont3,Danjittrong Taechasit4,Juntararuangtong Thitikorn1,Chombandit Theetad1

Affiliation:

1. School of Internal Medicine

2. School of Surgery, Institute of Medicine, Suranaree University of Technology, Nakhon Ratchasima

3. Department of Surgery, Faculty of Medicine, Ramathibodi hospital, Mahidol University, Bangkok

4. Department of Anesthesiology, Chulabhorn Hospital, Bangkok, Thailand

Abstract

Introduction and importance: Multiple-choice questions (MCQs) offer a suitable means to assess the cognitive domain of learners with a high degree of objectivity. The study's objective is to formulate an equation for determining the ideal timing for MCQ examinations, thereby inspiring the development of a model to estimate the duration of these examinations. Methods: The authors generated a specific computer program that integrated with the operating system of the examination. Technical-specific features included the ability to calculate the speed of students taking examinations with images or videos in the questions or options. This bespoke computer program was designed specifically for assessing individual students' MCQ test-taking pace and generating a proctor report in a computer-readable format. Subsequently, data derived from this program underwent regression analysis to determine the speed at which students completed MCQ examinations. Outcomes: The data were collected from a total of 1035 examinees, all of whom were non-native English speakers. The average reading rate was 62.38±20.4 words/min. It was found that the rate decreased significantly in difficult (50.65±6.9 words/min) items compared to easy (82.29±21.3 words/min) and intermediate (60.56±19.1 words/min) items (p<0.001), respectively. The linear regression analysis predicted option selection (words/min) as; 33.92+1.93(%tables/figures)+0.14(%recall)–0.37(%application), r2=0.45, p<0.001. Conclusion: It is not advisable to base the decision solely on reading time or time allocation. Examination administrators are advised to proactively plan ahead, with particular emphasis on establishing a well-defined taxonomy, as it constitutes a fundamental cornerstone in the utilization of the estimation equation.

Publisher

Ovid Technologies (Wolters Kluwer Health)

Reference24 articles.

1. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference;Norcini;Med Teach,2011

2. Assessment methods in medical education;Norcini;Teaching Teacher Educ,2007

3. E‐assessment by design: using multiple‐choice tests to good effect;Nicol;J Further Higher Educ,2007

4. Multiple choice questions: a literature review on the optimal number of options;Vyas;Natl Med J India,2008

5. The value of item response theory in clinical assessment: a review;Thomas;Assessment,2011

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3