Development of a performance-rating scale for a nutrition knowledge test developed for adolescents

Abstract

AbstractObjectiveThe objectives of the present study were to (i) develop and validate a norm-referenced performance-rating scale to interpret a nutrition knowledge test developed for urban adolescents and (ii) develop a prototype for other researchers to follow when developing nutrition knowledge tests.DesignFor norm development the nutrition knowledge test (questionnaire) was administered to a sample representative of the questionnaire target group, referred to as the norm group. These included 512 adolescents in grades 8 (n 158), 10 (n 149) and 12 (n 205) at three randomly selected schools in Soweto and Johannesburg. The performance scores (in percentages) obtained by the norm group were transformed to Z-scores which were categorised into stanines using established Z-score cut-off points. For validation purposes the questionnaire was completed by 148 volunteers: sixty university dietetics students, nineteen non-nutrition university students and sixty-nine primary-school teachers.ResultsAs required of an ideal norm group, the Z-scores formed a normal distribution (a bell-shaped curve). To facilitate interpretation of the results, the Z-score cut-off points for these categories were transformed back to performance scores (percentages) so that the performance of a testee could be interpreted directly from his/her performance in percentage. As is recommended, the nine stanine categories were reduced to five: very poor, fair/below average, good/average, very good/above average and excellent. The discriminatory validity of the norms was substantiated by showing that groups with known nutrition knowledge levels were rated appropriately and that the performance ratings of these groups differed significantly, with university dietetics students scoring 98·3 %, primary-school teachers 20·3 % and non-nutrition university students 31·6 %.ConclusionsThe norm-referenced performance-rating scale can be used with confidence to interpret the performance score achieved by a testee on the nutrition knowledge test developed for urban adolescents in South Africa. The methodology used in the study serves as a prototype for other researchers who are developing knowledge tests.