Unsubstantiated conclusions about the Family Star Plus as an outcome measure: a rebuttal to Sweet, Winter, Neeson and Connolly (2020)

Abstract

Purpose The purpose of this article is to explain why Sweet et al.'s assertions are not well founded and raise unsubstantiated doubt over the use of the Family star Plus and the Outcomes Star suite of tools as outcomes measures. Design/methodology/approach Evidence is presented of flaws in the analysis, reporting and conclusions of an article published in this journal (Sweet et al., 2020). Findings Sweet et al. failed to mention a body of Outcomes Star validation work, including over 20 online reports and a manuscript they had seen of a now published article supporting the reliability and validity of the Family Star Plus (Good and MacKeith, 2020). There are significant issues with their methodology, presentation of results and conclusions including: reliance on statistical significance with a small sample size; use of statistics not intended for ordinal data and; and inappropriate conclusions from convergence with measures conceptually different to the Family Star Plus. Originality/value Evidence is presented that the Family Star Plus is a useful and valid outcome measure and that Sweet et al.’s conclusions can be attributed to issues with their methodology and interpretation.