Examining the Intra-Rater Reliability of Transcranial Magnetic Stimulation (TMS)-Induced Motor Evoked Potentials (MEPs) Within and Between Sessions: A Step Towards Ensuring Accuracy of Observed MEP Changes in Repeated Measures Studies conducted by Newly Trained TMS Operators

Abstract

Background: An essential factor in the validity of motor evoked potential (MEP)s recorded by transcranial magnetic stimulation (TMS) over multiple times is their test-retest reliability which to a large extent depends on the accuracy and competence of the assessor (intra-rater reliability). However, intra-rater reliability is infrequently reported in TMS studies suggesting that this is rarely done. Objectives: This study was conducted to determine the intra-rater within and between-session reliability of a newly trained TMS assessor prior to a main TMS study and report on the methodology used to encourage similar practice. Methods: Fourteen (10 males, 4 females; mean age: 32 ± 5.8 years) participants took part in the study. Motor evoked potentials were elicited from a relaxed, right first dorsal interosseous (FDI) muscle three times (T1, T2 and T3) across two testing sessions at least 48 hours apart. During the first session, MEPs were recorded twice (T1 and T2) within an interval of 20 minutes to determine the within (intra) session reliability of the assessor. During the second session, a single measurement was carried out (T3) which was compared to T1 to determine the inter-session reliability. Results: Repeated measure analysis of variance (ANOVA) did not reveal significant difference in the amplitude of the MEPs obtained across the three time periods (P = 0.196) demonstrating agreement in the MEPs and hence the reliability of the assessor. Additionally, the intraclass correlation coefficient (ICC) between T1 and T2; and T1 and T3 were 0.952 (P < 0.001) and 0.833 (P = 0.001) respectively further indicating the within and between sessions reliability of the assessor. Conclusions: The agreement between the three measured MEPs amplitude and the significant ICC demonstrates the reliability of the assessor in this study to use TMS for research. We suggest that the intra-rater reliability of new TMS operators should be established using the methodology in this report prior to main TMS studies.