Abstract
This research aims to evaluate the performance of dimensionality determination methods under various simulation conditions. Therefore, dimensionality determination methods were compared, including optimal parallel analysis, MAP, HULL, EGA (TMFG) estimation, EGA (glasso) estimation, and comparison data forest method. The type of distribution, sample size, number of items per factor, number of categories, and measurement model were specified as simulation conditions in the study. For each condition, 100 replications were conducted. A fully crossed simulation design was employed in the study. The results of this study, which examined the performance of factor determination methods under skewed distributions, indicated that the HULL method had the highest average considering the average accuracy values of all conditions. Meanwhile, the HULL method had the lowest RB average. However, no method demonstrated adequate performance under all conditions. This study examined one-factor and two-factor structures with interfactor correlations of 0.00 and 0.30. Considering structures with more than two factors in education and psychology, future research could focus on working with data exhibiting skewed distributions involving more factors and items to compare the performance of methods.
Reference43 articles.
1. Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13(2), 186–203. https://doi.org/10.1207/s15328007sem1302_2
2. Cho, S.-J., Li, F., & Bandalos, D. L. (2009). Accuracy of the parallel analysis procedure with polychoric correlations. Educational and Psychological Measurement, 69(5), 748–759. https://doi.org/10.1177/0013164409332229
3. Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 27–29. https://doi.org/10.7275/jyj1-4868
4. Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16–29. https://doi.org/10.1037/1082-989X.1.1.16
5. Finch, W. H. (2020). Using Fit Statistic Differences to Determine the Optimal Number of Factors to Retain in an Exploratory Factor Analysis. Educational and Psychological Measurement, 80(2), 217–241. https://doi.org/10.1177/0013164419865769.