Instability of Inverse Probability Weighting Methods and a Remedy for Nonignorable Missing Data

Author:

Li Pengfei1ORCID,Qin Jing2ORCID,Liu Yukun3ORCID

Affiliation:

1. Department of Statistics and Actuarial Science, University of Waterloo , Waterloo, Ontario , Canada

2. National Institute of Allergy and Infectious Diseases, National Institutes of Health , Bethesda, Maryland , USA

3. KLATASDS – MOE, School of Statistics, East China Normal University , Shanghai , China

Abstract

Abstract Inverse probability weighting (IPW) methods are commonly used to analyze nonignorable missing data (NIMD) under the assumption of a logistic model for the missingness probability. However, solving IPW equations numerically may involve nonconvergence problems when the sample size is moderate and the missingness probability is high. Moreover, those equations often have multiple roots, and identifying the best root is challenging. Therefore, IPW methods may have low efficiency or even produce biased results. We identify the pitfall in these methods pathologically: they involve the estimation of a moment-generating function (MGF), and such functions are notoriously unstable in general. As a remedy, we model the outcome distribution given the covariates of the completely observed individuals semiparametrically. After forming an induced logistic regression (LR) model for the missingness status of the outcome and covariate, we develop a maximum conditional likelihood method to estimate the underlying parameters. The proposed method circumvents the estimation of an MGF and hence overcomes the instability of IPW methods. Our theoretical and simulation results show that the proposed method outperforms existing competitors greatly. Two real data examples are analyzed to illustrate the advantages of our method. We conclude that if only a parametric LR is assumed but the outcome regression model is left arbitrary, then one has to be cautious in using any of the existing statistical methods in problems involving NIMD.

Funder

National Key R&D Program of China

the 111 project

Natural Sciences and Engineering Research Council of Canada

National Natural Science Foundation of China

Publisher

Oxford University Press (OUP)

Subject

Applied Mathematics,General Agricultural and Biological Sciences,General Immunology and Microbiology,General Biochemistry, Genetics and Molecular Biology,General Medicine,Statistics and Probability

Reference37 articles.

1. A simple and efficient estimation method for models with non-ignorable missing data;Ai;Statistica Sinica,2020

2. A simple test for heteroscedasticity and random coefficient variation;Breusch;Econometrica,1979

3. Using calibration weighting to adjust for nonresponse under a plausible model;Chang;Biometrika,2008

4. Nonignorable missing data, single index propensity score and profile synthetic distribution function;Chen;Journal of Business & Economic Statistics,2022

5. Diagnostics for heteroscedasticity in regression;Cook;Biometrika,1983

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3