The Impact of Nondifferential Exposure Misclassification on the Performance of Propensity Scores for Continuous and Binary Outcomes: A Simulation Study

Abstract

PURPOSE: To investigate the ability of the propensity score (PS) to reduce confounding bias in the presence of nondifferential misclassification of treatment, using simulations. METHODS: Using an example from the pregnancy medication safety literature, we carried out simulations to quantify the effect of nondifferential misclassification of treatment under varying scenarios of sensitivity and specificity, exposure prevalence (10%, 50%), outcome type (continuous and binary), true outcome (null and increased risk), confounding direction, and different PS applications (matching, stratification, weighting, regression), and obtained measures of bias and 95% confidence interval coverage. RESULTS: All methods were subject to substantial bias toward the null due to nondifferential exposure misclassification (range: 0%-47% for 50% exposure prevalence and 0%-80% for 10% exposure prevalence), particularly if specificity was low ( < 97%). PS stratification produced the least biased effect estimates. We observed that the impact of sensitivity and specificity on the bias and coverage for each adjustment method is strongly related to prevalence of exposure: as exposure prevalence decreases and/or outcomes are continuous rather than categorical, the effect of misclassification is magnified, producing larger biases and loss of coverage of 95% confidence intervals. PS matching resulted in unpredictably biased effect estimates. CONCLUSIONS: The results of this study underline the importance of assessing exposure misclassification in observational studies in the context of PS methods. Although PS methods reduce confounding bias, bias owing to nondifferential misclassification is of potentially greater concern.