Early Warning Indicators in Education: Innovations, Uses, and Optimal Conditions for Effectiveness

Abstract

Background/Context The passage of the No Child Left Behind Act in 2002 and the Every Student Succeeds Act in 2015 spurred changes in the way educators use data. On the one hand, the policies inspired educators’ awareness of large gaps in achievement between subgroups based on gender, race, and socioeconomic status. On the other hand, the policies inspired the use of data-based indicators in day-to-day routines in schools. In some cases, practitioners started working with researchers to analyze data using advanced measurement techniques to develop “early warning indicators.” These indicators identify when students are at risk of not achieving key milestones, such as graduating from high school, in hopes of providing practitioners with time to intervene early enough to change the students’ trajectories. Educational leaders have created “early warning systems” that produce reports summarizing these indicators, provide a process for the leaders to organize interventions based on the indicator reports, and a further process to examine whether students are back on track toward milestones such as high school graduation as a result of the intervention. Given the pace at which the science and use of these indicators is advancing, the topic is in need of a new resource explaining the most up-to-date elements involved with early warning indicators. Purpose/Focus of the Study This article will describe the evolution of the research, use, and conditions that influence the use of early warning indicators. The review of the literature includes a description of each of the yearbook articles and how they summarize some of the most recent advancements in early warning indicators in education. Research Design This is a review of literature. Findings As indicators in education have improved, these indicators show practitioners when students are not on track to reach certain milestones and provide practitioners with time to intervene early enough to change the child's trajectory. Allensworth and other authors (e.g., Balfanz et al.; Faria et al.; and Soland) provide evidence that these early warning indicators are impactful when used by practitioners in certain ways. Earlier efforts around early warning indicators focused on identifying measures that were predictive of key outcomes, such as high school graduation. As efforts to use indicators in practice became more mature, the focus expanded from providing information through indicators and information systems to ensuring that practitioners had the capacity and opportunity to engage in indicator use to guide their daily practice, and that the conditions in schools, school districts, and states supported indicator use. More recently, methodological advances around data analytics and a growing interest in social–emotional learning have expanded the approach and scope of indicators and their use. That said, the research on the nature and use of these indicators needs further documentation to keep up with the rapid pace at which the indicators are advancing and becoming more precise. The field still lacks a robust research base on how to use the indicators to improve practices and policies, and what conditions support the development and use of the indicators in education. Conclusions/Recommendations We will explain how the studies in this yearbook provide more up-to-date information on measurement related to the indicators, on the influence of certain approaches to using the indicators, as well as research on how conditions interact with the development and use of the indicators. The article demonstrates an important slice of what the field knows, as well as challenges and opportunities for further work to improve the development and use of early warning indicators.