Primary Submission Category: Difference in Differences, Synthetic Control, Methods for Panel and Longitudinal Data
In Defense of the Pre-Test: Valid Inference when Testing Violations of Parallel Trends for Difference-in-Differences
Authors: Jonas Mikhaeil, Christopher Harshaw,
Presenting Author: Jonas Mikhaeil*
The difference-in-differences (DID) design is a key identification strategy which allows to estimate causal effects under the parallel trends assumption. While the parallel trends assumption is counterfactual and cannot be tested directly, researchers often examine pre-treatment periods to check whether the time trends are parallel before treatment is administered. Recently, researchers have been cautioned against using preliminary tests which aim to detect violations of parallel trends in the pre-treatment period. We argue that preliminary testing should play an important role within the DID research design. We propose a new and more substantively appropriate conditional extrapolation assumption, which requires to conduct a preliminary test to determine whether the severity of pre-treatment parallel trend violations falls below an acceptable level before extrapolation to the post-treatment period is justified. This stands in contrast to prior work which can be interpreted as either setting the acceptable level to be exactly zero (in which case preliminary tests lack power) or assuming that extrapolation is always justified (in which case preliminary tests are not required). Under mild assumptions, we provide a consistent preliminary test as well confidence intervals which are valid when conditioned on the result of the test. The conditional coverage of these intervals overcomes a common critique made against the use of preliminary testing within the DID design.