Protecting the integrity of survey research

Author:

Jamieson Kathleen Hall1ORCID,Lupia Arthur2ORCID,Amaya Ashley3ORCID,Brady Henry E4ORCID,Bautista René5ORCID,Clinton Joshua D6ORCID,Dever Jill A7,Dutwin David8ORCID,Goroff Daniel L9,Hillygus D Sunshine10ORCID,Kennedy Courtney3ORCID,Langer Gary11ORCID,Lapinski John S12,Link Michael13,Philpot Tasha14,Prewitt Ken15,Rivers Doug16,Vavreck Lynn17ORCID,Wilson David C18ORCID,McNutt Marcia K19ORCID

Affiliation:

1. Annenberg Public Policy Center, University of Pennsylvania , Philadelphia, PA 19104 , USA

2. Department of Political Science, University of Michigan , 505 South State Street, Ann Arbor, MI 48106 , USA

3. Pew Research Center , 1615 L Street NW #800, Washington, DC 20036 , USA

4. Goldman School of Public Policy, University of California , 2607 Hearst Ave, Berkeley, CA 94720 , USA

5. Methodology and Quantitative Social Science Department, NORC at the University of Chicago , Chicago, IL 60637 , USA

6. Department of Political Science, Vanderbilt University , 230 Appleton Place, Nashville, TN 37203 , USA

7. Division for Statistical and Data Sciences, RTI International , Washington, DC 20005-3967 , USA

8. Center for Panel Survey Sciences, NORC at the University of Chicago , 55 East Monroe Street, Chicago, IL 60618 , USA

9. Alfred P. Sloan Foundation , 630 Fifth Avenue, New York, NY 10111 , USA

10. Department of Political Science, Duke University , 140 Science Dr, Durham, NC 27707 , USA

11. Langer Research Associates , Carmel, NY 10512 , USA

12. Department of Political Science, University of Pennsylvania , 133 South 36th Street, Philadelphia, PA 19104 , USA

13. Ipsos , Canton, GA 30115 , USA

14. Department of Government, University of Texas at Austin , 158 W 21st Street, Austin, TX 78712 , USA

15. Department of Political Science, Columbia University , New York City, NY 10012 , USA

16. Department of Political Science, Stanford University , Stanford, CA 94305 , USA

17. Department of Political Science, University of California Los Angeles , Los Angeles, CA 90095 , USA

18. Goldman School of Public Policy, University of California, Berkeley , Berkeley, CA 94720 , USA

19. National Academy of Sciences , 500 5th Street NW, Washington, DC 20001 , USA

Abstract

Abstract Although polling is not irredeemably broken, changes in technology and society create challenges that, if not addressed well, can threaten the quality of election polls and other important surveys on topics such as the economy. This essay describes some of these challenges and recommends remediations to protect the integrity of all kinds of survey research, including election polls. These 12 recommendations specify ways that survey researchers, and those who use polls and other public-oriented surveys, can increase the accuracy and trustworthiness of their data and analyses. Many of these recommendations align practice with the scientific norms of transparency, clarity, and self-correction. The transparency recommendations focus on improving disclosure of factors that affect the nature and quality of survey data. The clarity recommendations call for more precise use of terms such as “representative sample” and clear description of survey attributes that can affect accuracy. The recommendation about correcting the record urges the creation of a publicly available, professionally curated archive of identified technical problems and their remedies. The paper also calls for development of better benchmarks and for additional research on the effects of panel conditioning. Finally, the authors suggest ways to help people who want to use or learn from survey research understand the strengths and limitations of surveys and distinguish legitimate and problematic uses of these methods.

Publisher

Oxford University Press (OUP)

Cited by 5 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Publishing survey research;Proceedings of the National Academy of Sciences;2024-04-24

2. The political fallout of air pollution;Proceedings of the National Academy of Sciences;2024-04-23

3. The extent of use of surveys in policymaking: the case of Hong Kong;Evidence & Policy;2023-11-23

4. Great Lakes for whom? Community outcomes in the Muskegon Lake and White Lake areas of concern;Journal of Great Lakes Research;2023-10

5. Are Nonprobability Surveys Fit for Purpose?;Public Opinion Quarterly;2023-09-01

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3