Affiliation:
1. GAZI UNIVERSITY, GAZİ FACULTY OF EDUCATION
2. ADNAN MENDERES UNIVERSITY
Abstract
This study aims to generalize the reliability of the GAAIS, which is known to perform valid and reliable measurements, is frequently used in the literature, aims to measure one of today's popular topics, and is one of the first examples developed in the field. Within the meta-analytic reliability generalization study, moderator analyses were also conducted on some categorical and continuous variables. Cronbach's α values for the overall scale and the positive and negative subscales, and McDonald's ω coefficients for positive and negative subscales were generalized. Google Scholar, WOS, Taylor & Francis, Science Direct, and EBSCO databases were searched to obtain primary studies. As a result of the screening, 132 studies were found, and these studies were reviewed according to the inclusion criteria. Reliability coefficients obtained from 19 studies that met the criteria were included in the meta-analysis. While meta-analytic reliability generalization was performed according to the random effects model, moderator analyses were performed according to the mixed effect model based on both categorical variables and continuous variables. As a result of the research pooled, Cronbach's α was 0.881, 0.828, and 0.863 for total, the negative, and positive subscales respectively. Also, McDonald's ω was 0.873 and 0.923 for negative and positive subscales respectively. It was found that there were no significant differences between the reliability coefficients for all categorical variables. On the other hand, all continuous moderator variables (mean age, standard deviation age, and rate of female) had a significant effect.
Publisher
International Journal of Assessment Tools in Education
Reference70 articles.
1. Alcocer‐Bruno, C., Ferrer‐Cascales, R., Rubio‐Aparicio, M., & Ruiz‐Robledillo, N. (2020). The medical outcome study‐HIV health survey: A systematic review and reliability generalization meta‐analysis. Research in Nursing & Health, 43(6), 610-620. https://doi.org/10.1002/nur.22070
2. Arslan, K. (2020). Eğitimde yapay zekâ ve uygulamaları [Artificial intelligence and applications in education]. The Western Anatolia Journal of Educational Sciences, 11(1), 71-88. https://dergipark.org.tr/tr/pub/baebd/issue/55426/690058
3. Aslan, Ö.S., Gocen, S., & Sen, S. (2022). Reliability generalization meta-analysis of mathematics anxiety scale for primary school students. Journal of Measurement and Evaluation in Education and Psychology, 13(2), 117 133. https://doi.org/10.21031/epod.1119308
4. Begg, C.B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088. https://doi.org/10.2307/2533446
5. *Bellaiche, L., Shahi, R., Turpin, M.H., Ragnhildstveit, A., Sprockett, S., Barr, N., ... & Seli, P. (2023). Humans versus AI: Whether and why we prefer human-created compared to AI-created artwork. Cognitive Research: Principles and Implications, 8(1), 1-22. https://doi.org/10.1186/s41235-023-00499-6