Validation of the research capacity and culture (RCC) tool: measuring RCC at individual, team and organisation levels

Abstract

Research capacity building (RCB) in Australia has recently focussed on strategies that take a whole of system approach to developing research culture at individual, team and organisation levels. Although a theoretical framework exists, no tool has been published that quantitatively measures the effectiveness of RCB interventions aimed at these three levels. A sample of 134 allied health workers was used to validate the research capacity and culture (RCC) tool. Item level analysis was undertaken using Cronbach’s α and exploratory factor analysis, and test–retest reliability was examined using intra-class correlations (ICC). The tool had one factor emerge for each domain, with excellent internal consistency for organisation, team and individual domains (α = 0.95, 0.96 and 0.96 respectively; and factor loadings ranges of 0.58–0.89, 0.65–0.89 and 0.59–0.93 respectively). The overall mean score (total) for each domain was: 5.4 (inter-quartile range 3.9–7.7), 4.4 (IQR 2.6–6.1) and 3.9 (IQR 2.9–6) for the organisation, team and individual domains respectively. Test–retest reliability was strong for each domain: organisation ICC = 0.77, team ICC = 0.83 and individual ICC = 0.82. The RCC tool has three domains measuring research capacity and culture at organisation, team and individual levels. It demonstrates excellent internal consistency and strong test–retest reliability.