Abstract
AbstractDiagnostic theories are fundamental to Information Systems practice and are represented in trees. One way of creating diagnostic trees is by employing independent experts to construct such trees and compare them. However, good measures of similarity to compare diagnostic trees have not been identified. This paper presents an analysis of the suitability of various measures of association to determine the similarity of two diagnostic trees using bootstrap simulations. We find that three measures of association, Goodman and Kruskal’s Lambda, Cohen’s Kappa, and Goodman and Kruskal’s Gamma (J Am Stat Assoc 49(268):732–764, 1954) each behave differently depending on what is inconsistent between the two trees thus providing both measures for assessing alignment between two trees developed by independent experts as well as identifying the causes of the differences.
Publisher
Springer Science and Business Media LLC
Subject
General Social Sciences,Statistics and Probability
Reference37 articles.
1. Anderson, J., Gerbing, D.: Structural equation modeling in practice: a review and recommended two-step approach. Psychol. Bull. 103(3), 411–423 (1988)
2. Baker, F.B.: Stability of two hierarchical grouping techniques case I: sensitivity to data errors. J. Am. Stat. Assoc. 69(346), 440–445 (1974)
3. Boudreau, M.-C., Gefen, D., Straub, D.W.: Validation in information systems research. MIS Q. 25(1), 1–16 (2001)
4. Clauset, A., Moore, C., Newman, M.: Hierarchical structure and the prediction of missing links in networks. Nature 453(May), 98–101 (2008)
5. Cohen, J.: Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol. Bull. 70(4), 213–220 (1968)