Primary Submission Category: Randomized Designs and Analyses
Improving Variance Estimation for Covariate Adjustment with Binary Outcomes
Authors: Kaitlyn Lee, Courtney Schiffman, Alex Ocampo, Michel Friesenhan, Christina Rabe, Michael Rosenblum,
Presenting Author: Kaitlyn Lee*
Covariate adjustment is a general method for improving precision when estimating treatment effects in randomized trials and is recommended by the FDA in its recent guidance when baseline variables are prognostic for the primary outcome. We focus on a method highlighted in that guidance called “standardization” (or “g-computation”) for estimating the marginal treatment effect. We address the question of how to reliably estimate variance for binary outcomes when marginal outcome probabilities are close to 0 or 1. We propose an influence function-based leave-one-out cross-validated (LOO-CV) variance estimator for the standardized difference-in-means average treatment effect. Through simulation studies, we show that this estimator provides appropriate type I error control and performs reliably in challenging settings where existing methods can yield inflated type I error or fail entirely, such as when outcome events are rare or sample sizes are small. In addition to having desirable statistical properties, we derive a closed-form expression for the proposed estimator, enabling straightforward and reliable implementation by study statisticians. The robust finite-sample performance and ease of implementation suggest the LOO-CV variance estimator is a prudent default choice for standardization in clinical trials.