Analysing use of evidence in public policymaking processes: a theory-grounded content analysis methodology

Abstract

A broad range of methodologies is routinely employed to track and analyse use of research evidence in public policymaking. However, available methods and tools are mostly equipped to track ‘evidence’ but are less equipped to capture and represent ‘use’ of evidence. In particular, existing methods overlook policymakers’ frequent use of evidence for political persuasion and bargaining. Drawing on established theories and research tools from the field of persuasive communication, we developed a content analysis instrument for tracking and analysing policymakers’ use of evidence based on the information contained in policy documents. We provide a specific example of applying this tool and demonstrate how it may be used to generate rich and nuanced insights regarding the scope, nature, and timing of policymakers’ evidence use at different levels and phases of the public policymaking process. We conclude with a discussion of potential strengths and limitations and offer recommendations regarding the optimal application of this methodology.