Revisiting the Synthetic Control Estimator

Ferman, Bruno and Pinto, Cristine (2016): Revisiting the Synthetic Control Estimator.

Abstract

We analyze the conditions under which the Synthetic Control (SC) estimator is unbiased. We show that the SC estimator is generally biased if treatment assignment is correlated with time-varying unobserved confounders, even when the number of pre-treatment periods goes to infinity and in settings where one should expect to have an almost perfect pre-treatment fit. While we also show that a modified version of the SC method can substantially improve relative to standard methods, our results suggest that researchers should be more careful in interpreting the identification assumptions required for this method.

• Item Type: MPRA Paper
• Language: English
• Keywords: synthetic control, difference-in-differences; linear factor model
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C13 - Estimation: General; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C21 - Cross-Sectional Models ; Spatial Models ; Treatment Effect Models ; Quantile Regressions; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C23 - Panel Data Models ; Spatio-temporal Models

References

Abadie, Alberto, Alexis Diamond, and Jens Hainmueller, “Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program,” Journal of the American Statiscal Association, 2010, 105 (490), 493–505.

Abadie, Alberto, Alexis Diamond, and Jens Hainmueller, “Comparative Politics and the Synthetic Control Method,” American Journal of Political Science, 2015, 59 (2), 495–510.

Abadie, Alberto, and Javier Gardeazabal, “The Economic Costs of Conflict: A Case Study of the Basque Country,” American Economic Review, 2003, 93 (1), 113–132.

Ando, Michihito and Fredrik S¨avje, “Hypothesis Testing with the Synthetic Control Method,” 2013. Working Paper.

Athey, Susan and Guido W. Imbens, “The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, May 2017, 31 (2), 3–32.

Borwein, Jonathan and Jon Vanderwerff, “Epigraphical and uniform convergence of convex functions,” Transactions of the American Mathematical Society, 1996, 348 (4), 1617–1631.

Carvalho, Carlos V., Ricardo Mansini, and Marcelo C. Medeiros, “ArCo: An Artificial Counter- factual Approach for Aggregate Data,” February 2015. Working Paper.

Carvalho, Carlos V., Ricardo Mansini, and Marcelo C. Medeiros, “The Perils of Counterfactual Analysis with Integrated Processes,” 2016. Working Paper.

Chernozhukov, Victor, Han Hong, and Elie Tamer, “Estimation and Confidence Regions for Parameter Sets in Econometric Models,” Econometrica, 2007, 75 (5), 1243–1284.

Doudchenko, Nikolay and Guido Imbens, “Balancing, regression, difference-in-differences and synthetic control methods: A synthesis,” 2016.

Ferman, Bruno and Cristine Pinto, “Placebo Tests for Synthetic Controls,” MPRA Paper 78079, University Library of Munich, Germany April 2017.

Ferman, Bruno and Cristine Pinto, and Vitor Possebom, “Cherry Picking with Synthetic Controls,” 2016. Working Paper.

Firpo, Sergio and Vitor Possebom, “Synthetic Control Estimator: A Generalized Inference Procedure and Confidence Sets,” April 2016.

Gobillon, Laurent and Thierry Magnac, “Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls,” The Review of Economics and Statistics, 2016, 98 (3), 535–551.

Hamilton, James Douglas, Time series analysis, Princeton, NJ: Princeton Univ. Press, 1994.

Hsiao, Cheng, H. Steve Ching, and Shui Ki Wan, “A Panel Data Approach for Program Evaluation: Measuring the Benefits of Political and Economic Integration of Hong Kong with Mainland China,” Journal of Applied Econometrics, 2012, 27 (5), 705–740.

Kaul, Ashok, Stefan Kl¨obner, Gregor Pfeifer, and Manuel Schieler, “Synthetic Control Methods: Never Use All Pre-Intervention Outcomes as Economic Predictors,” May 2015. Working Paper.

Newey, Whitney K. and Daniel McFadden, “Chapter 36 Large sample estimation and hypothesis testing,” in “in,” Vol. 4 of Handbook of Econometrics, Elsevier, 1994, pp. 2111 – 2245.

Phillips, P. C. B., “Optimal Inference in Cointegrated Systems,” Econometrica, 1991, 59 (2), 283–306.

Powell, David, “Imperfect Synthetic Controls: Did the Massachusetts Health Care Reform Save Lives?,” 2017.

Wong, Laurence, “Three Essays in Causal Inference.” PhD dissertation, Stanford University March 2015.

Xu, Yiqing, “Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models,” Political Analysis, 2017, 25 (1), 57?76.