A Computer Program for Calculating Subject-by-Subject Kappa or Weighted Kappa Coefficients

Abstract

This computer program calculates individual subject kappa or weighted kappa coefficients for each of the following three types of categorical data: (a) nominal (dichotomous/polychotomous), (b) ordinal (dichotomous /continuous), and (c) mixed scales of measurement (containing both nominal and ordinal features). Additional output includes criteria for determining levels of both statistical and clinical significance as well as specific tests of examiner bias.