Long-Term Test-Retest Reliability of Baseline Cognitive Assessments Using ImPACT

Abstract

Background Computer-based assessment programs are commonly used to document baseline cognitive performance for comparison with postconcussion testing. There are currently no guidelines for how often baseline assessments should be updated, and no data documenting the test-retest stability of baseline measures over relevant time periods. Purpose To establish long-term test-retest reliability of baseline assessments using ImPACT, and to compare various statistical methods for establishing test-retest reliability. Study Design Case series; Level of evidence, 4. Methods Participants were 95 collegiate varsity athletes completing baseline cognitive testing at 2 time periods, approximately 2 years apart. No participant sustained a concussion between assessments. All athletes completed the ImPACT test battery; dependent measures were the composite scores and total symptom scale score. Results Intraclass correlation coefficient estimates for visual memory (.65), processing speed (.74), and reaction time (.68) composite scores reflected stability over the 2-year period, with greater variability in verbal memory (.46) and symptom scale (.43) scores. Using reliable change indices and regression-based methods, only a small percentage of participants’ scores showed “reliable” or “significant” change on the composite scores (0%-6%), or symptom scale scores (5%-10%). Conclusion The current results suggest that college athletes’ cognitive performance at baseline remains considerably stable over a 2-year period. These data help establish the effects of longer, clinically pragmatic testing intervals on test-retest reliability. Clinical Implications The current results suggest that stretching the time between baseline assessments from 1 to 2 years may have little effect on the clinical management of concussions in collegiate athletes. These results should not be generalized to collegiate football players, who were not included in this sample. Youth athletes (high school and younger) should continue to receive annually updated baseline assessments until prospective study of the stability of baseline assessments for this younger age group can be completed.