Abstract
AbstractSelf-report assessments are used frequently in higher education to assess a variety of constructs, including attitudes, opinions, knowledge, and competence. Systems thinking is an example of one competence often measured using self-report assessments where individuals answer several questions about their perceptions of their own skills, habits, or daily decisions. In this study, we define systems thinking as the ability to see the world as a complex interconnected system where different parts can influence each other, and the interrelationships determine system outcomes. An alternative, less-common, assessment approach is to measure skills directly by providing a scenario about an unstructured problem and evaluating respondents’ judgment or analysis of the scenario (scenario-based assessment). This study explored the relationships between engineering students’ performance on self-report assessments and scenario-based assessments of systems thinking, finding that there were no significant relationships between the two assessment techniques. These results suggest that there may be limitations to using self-report assessments as a method to assess systems thinking and other competencies in educational research and evaluation, which could be addressed by incorporating alternative formats for assessing competence. Future work should explore these findings further and support the development of alternative assessment approaches.
Funder
Division of Engineering Education and Centers
Publisher
Springer Science and Business Media LLC
Subject
General Engineering,Education
Reference63 articles.
1. Ackoff, R. L. (1971). Towards a system of systems concepts. Management Science, 17(11), 661–671. https://doi.org/10.1287/mnsc.17.11.661
2. Ackoff, R. L. (1994). Systems thinking and thinking systems. System Dynamics Review, 10(2–3), 175–188.
3. ACPA College Student Educators International. (2008). Toward a sustainable future: The role of student affairs in creating healthy environments, social justice, and strong economies. American College Personnel Association.
4. Anderson, R., Thier, M., & Pitts, C. (2017). Interpersonal and intrapersonal skill assessment alternatives: Self-reports, situational-judgment tests, and discrete-choice experiments. Learning and Individual Differences, 53, 47–60. https://doi.org/10.1016/j.lindif.2016.10.017
5. Bowman, N. (2010). Assessing learning and development among diverse college students. New Directions for Institutional Research, 145, 53–71. https://doi.org/10.1002/ir.322
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献