Learning Curve: Progress in the Replication Crisis

Abstract

We present detailed monitoring data across a five-country randomized trial of phone-based targeted tutoring–one of the largest multicountry replication efforts in education to date. We study an approach shown to work in Botswana and replicated in India, Kenya, Nepal, the Philippines, and Uganda. While the existing literature often finds diminishing effects as proof-of-concept studies are replicated and scaled, we find the opposite: implementation fidelity (the degree of targeted educational instruction) improves across replications and over time. This demonstrates that replication is not intractable; rather, equipped with mechanisms to learn from experience, organizational “learning curves” can enable effective replication and scale-up.