A Mixed Methods Evaluation of Sharing Air Pollution Results with Study Participants via Report-Back Communication

Abstract

We implemented a concurrent triangulation mixed-methods evaluation of an air pollution data report-back to study participants in Chelsea, Massachusetts. We aimed to determine whether the report-back was effective in the following three ways: engagement, understandability, and actionability for the participants. We also evaluated participants’ valuation of the report-back information and process. The evaluation involved both qualitative components, such as ethnographic observation, and quantitative components, such as closed-ended questionnaires and demographic data. The participants who engaged in the report-back process were significantly different from those who did not engage both in terms of their demographics, and in their indoor air pollutant concentrations. Participant understanding generally corresponded with the intended meaning of the research team, suggesting successful data communication. Additionally, many of the participants reported that they were inspired to take action in order to reduce their indoor air pollutant exposure as a result of the report-back process and information provided. These results identify areas of improvement for engagement, particularly regarding populations that may have higher exposures. This work outlines a framework with which to contextualize and evaluate the success of engagement with report-back efforts. Such evaluations can allow research teams to assess whether they are providing information that is equitably useful and actionable for all participants.