Revisiting the Synthetic Control Estimator

Ferman, Bruno and Pinto, Cristine (2016): Revisiting the Synthetic Control Estimator.

Abstract

The synthetic control (SC) method has been recently proposed as an alternative to estimate treatment effects in comparative case studies. In this paper, we revisit the SC method in a linear factor model setting and derive conditions under which the SC estimator is asymptotically unbiased when the number of pre-treatment periods goes to infinity. If the pre-treatment averages of the first and second moments of the common factors converge, then we show that the SC estimator is asymptotically biased if there is selection on unobservables. In this case, the bias goes to zero when the variance of the transitory shocks is small, which is also the case in which it is more likely that the pre-treatment fit will be good. In models with non-stationary common factors, however, we show that the asymptotic bias may not go to zero even when the pre-treatment fit is almost perfect. Finally, we show that a demeaned version of the SC estimator can substantially improve relative to the difference-in-differences (DID) estimator, both in terms of bias and variance. Overall, our results show that the SC method can substantially improve relative to the DID estimator. However, researchers should be more careful in interpreting the identification assumptions required for this method.

• Item Type: MPRA Paper
• Language: English
• Keywords: synthetic control, difference-in-differences; linear factor model
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C13 - Estimation: General; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C21 - Cross-Sectional Models ; Spatial Models ; Treatment Effect Models ; Quantile Regressions; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C23 - Panel Data Models ; Spatio-temporal Models

References

Abadie, Alberto, Alexis Diamond, and Jens Hainmueller, “Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program,” Journal of the American Statiscal Association, 2010, 105 (490), 493–505.

Abadie, Alberto, Alexis Diamond, and Jens Hainmueller, “Comparative Politics and the Synthetic Control Method,” American Journal of Political Science, 2015, 59 (2), 495–510.

Abadie, Alberto, and Javier Gardeazabal, “The Economic Costs of Conflict: A Case Study of the Basque Country,” American Economic Review, 2003, 93 (1), 113–132.

Ando, Michihito and Fredrik S¨avje, “Hypothesis Testing with the Synthetic Control Method,” 2013. Working Paper.

Athey, Susan and Guido Imbens, “The State of Applied Econometrics-Causality and Policy Evaluation,” arXiv preprint arXiv:1607.00699, 2016.

Canay, Ivan A., Joseph P. Romano, and Azeem M. Shaikh, “Randomization Tests under an Approximate Symmetry Assumption?,” 2014.

Carvalho, Carlos V., Ricardo Mansini, and Marcelo C. Medeiros, “ArCo: An Artificial Counter- factual Approach for Aggregate Data,” February 2015. Working Paper.

Chernozhukov, Victor, Han Hong, and Elie Tamer, “Estimation and Confidence Regions for Parameter Sets in Econometric Models,” Econometrica, 2007, 75 (5), 1243–1284.

Doudchenko, Nikolay and Guido Imbens, “Balancing, regression, difference-in-differences and synthetic control methods: A synthesis,” 2016.

Ferman, Bruno and Cristine Pinto, “Inference in Differences-in-Differences with Different Group Sizes,” 2016. Working Paper.

Ferman, Bruno and Cristine Pinto, and Vitor Possebom, “Cherry Picking with Synthetic Controls,” 2016. Working Paper.

Firpo, Sergio and Vitor Possebom, “Synthetic Control Estimator: A Generalized Inference Procedure and Confidence Sets,” April 2016.

Gathani, Sachin, Massimiliano Santini, and Dimitri Stoelinga, “Innovative Techniques to Evaluate the Impacts of Private Sector Developments Reforms: An Application to Rwanda and 11 other Countries.” Working Paper.

Gobillon, Laurent and Thierry Magnac, “Regional Policy Evaluation: Interative Fixed Effects and Synthetic Controls,” Review of Eco- nomics and Statistics, 2016. Forthcoming.

Hahn, Jinyong and Ruoyao Shi, “Synthetic Control and Inference,” 2016.

Kaul, Ashok, Stefan Kl¨obner, Gregor Pfeifer, and Manuel Schieler, “Synthetic Control Methods: Never Use All Pre-Intervention Outcomes as Economic Predictors,” May 2015. Working Paper.

Newey, Whitney K. and Daniel McFadden, “Chapter 36 Large sample estimation and hypothesis testing,” in “in,” Vol. 4 of Handbook of Econometrics, Elsevier, 1994, pp. 2111 – 2245.

Powell, David, “Synthetic Control Estimation Beyond Case Studies: Does the Minimum Wage Reduce Employment?,” 2016. RAND Corporation, WR-1142.

Wong, Laurence, “Three Essays in Causal Inference.” PhD dissertation, Stanford University March 2015.

Xu, Yiqing, “Regional Policy Evaluation: Interative Fixed Effects and Synthetic Controls,” Political Anal- ysis, 2016. Forthcoming.