Subjects' Reactions to Computer-Based Tests

Abstract

This article reports the reactions of subjects who completed an attitudinal questionnaire after taking a battery of computer-based tests. The research focus concerned gauging reactions to innovative test types—where considerably more was demanded of subjects than merely a multiple-choice keyboard stroke. This article argues that “consumer validity”—subjects' attitudes and feelings toward a test—is an important factor in test design, since, if it is ignored, there may well be adverse effects on test scores. “Consumer validity” in the current study has therefore been operationalised as a score of 66 percent positive reaction on attitudinal questions. The study illustrates that although subjects participating in the study were familiar with computers, their reactions to the tests were mixed. On a number of questions—such as readiness for the test, preference for test medium and enjoying taking the test—the threshold of 66 percent was not always reached. The article ends with a note of caution with regard to computer-based testing, arguing that if subjects are not clear about what to do in a computer-based test, or cannot perform as well through the medium of the computer as they can on pen and paper, then the test will not be delivering optimum results—with corresponding implications as to the reliability of the results.