Two-method planned missing designs for longitudinal research

Abstract

We examine longitudinal extensions of the two-method measurement design, which uses planned missingness to optimize cost-efficiency and validity of hard-to-measure constructs. These designs use a combination of two measures: a “gold standard” that is highly valid but expensive to administer, and an inexpensive (e.g., survey-based) measure that contains systematic measurement bias (e.g., response bias). Using simulated data on four measurement occasions, we compared the cost-efficiency and validity of longitudinal designs where the gold standard is measured at one or more measurement occasions. We manipulated the nature of the response bias over time (constant, increasing, fluctuating), the factorial structure of the response bias over time, and the constraints placed on the latent variable model. Our results showed that parameter bias is lowest when the gold standard is measured on at least two occasions. When a multifactorial structure was used to model response bias over time, it is necessary to have the “gold standard” measures included at every time point, in which case most of the parameters showed low bias. Almost all parameters in all conditions displayed high relative efficiency, suggesting that the 2-method design is an effective way to reduce costs and improve both power and accuracy in longitudinal research.