Testing the Test: Expanding the Dialogue on Technical Writing Assessment in the Academy and Workplace

Abstract

The small amount of work on workplace writing assessment has focused almost entirely on student readiness for professional writing or included case studies of employer expectations for new writers. While these studies provide insight into current pedagogies for technical writing and writing instruction in general, the main conclusion to be drawn from them is the unsatisfactory number of recent graduates who display workplace readiness. In this article, we explore writing assessment research in both the academy and the workplace and attempt to identify ways in which the academy’s assessment practices lead, lag behind, or simply differ from writing assessment in the workplace. This comparison will serve to identify not only where the academy might improve pedagogy in its curriculum for technical communication in order to best prepare students for workplace writing but also where the workplace might learn from the academy to improve its own hiring and training procedures for technical writers. In this case study, we used Neff’s approach to grounded theory to categorize rater feedback according to a ranking system and then used statistical analysis to compare writer performance. We found that the direct test method yields the most predictive results when raters combine tacit knowledge with a clearly defined rubric. We hope that the methods used in this study can be replicated in future studies to yield further results when exploring workplace genres and what they might teach us about our own pedagogical practice.