Abstract
AbstractCognitive presence is a core construct of the Community of Inquiry (CoI) framework. It is considered crucial for deep and meaningful online-based learning. CoI-based real-time dashboards visualizing students’ cognitive presence may help instructors to monitor and support students’ learning progress. Such real-time classifiers are often based on the linguistic analysis of the content of posts made by students. It is unclear whether these classifiers could be improved by considering other learning traces, such as files attached to students’ posts. We aimed to develop a German-language cognitive presence classifier that includes linguistic analysis using the Linguistic Inquiry and Word Count (LIWC) tool and other learning traces based on 1,521 manually coded meaningful units from an online-based university course. As learning traces, we included not only the linguistic features from the LIWC tool, but also features such as attaching files to a post, tagging, or using terms from the course glossary. We used the k-nearest neighbor method, a random forest model, and a multilayer perceptron as classifiers. The results showed an accuracy of up to 82% and a Cohen’s κ of 0.76 for the cognitive presence classifier for German posts. Including learning traces did not improve the predictive ability. In conclusion, we developed an automatic classifier for German-language courses based on a linguistic analysis of students’ posts. This classifier is a step toward a teacher dashboard. Our work also provides the first fully CoI-coded German dataset for future research on cognitive presence.
Publisher
Springer Science and Business Media LLC
Subject
Computational Theory and Mathematics,Education
Reference46 articles.
1. Ally, M. (2004). Foundations of Educational Theory for Online Learning. In T. Anderson, & F. Elloumi (Eds.), Theory and practice of Online Learning (2nd ed., pp. 3–31). Athabasca University.
2. Alwafi, E. M. (2022). Designing an online discussion strategy with Learning Analytics Feedback on the level of Cognitive Presence and Student Interaction in an online Learning Community. Online Learning, 26(1), 80–92. https://doi.org/10.24059/OLJ.V26I1.3065.
3. Barbosa, G., Camelo, R., Cavalcanti, A. P., Miranda, P., Ferreira Mello, R., Kovanović, V., & Gašević, D. (2020). Towards automatic cross-language classification of cognitive presence in online discussions. ACM International Conference Proceeding Series, 605–614. https://doi.org/10.1145/3375462.3375496
4. Barbosa, A., Ferreira, M., Ferreira Mello, R., Dueire Lins, R., & Gašević, D. (2021). The impact of automatic text translation on classification of online discussions for social and cognitive presences. LAK21: 11th International Learning Analytics and Knowledge Conference, 77–87. https://doi.org/10.1145/3448139.3448147
5. Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004). A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explorations Newsletter, 6(1), 20–29. https://doi.org/10.1145/1007730.1007735.