Lagged Explanatory Variables and the Estimation of Causal Effects

Bellemare, Marc F. and Masaki, Takaaki and Pepinsky, Thomas B. (2015): Lagged Explanatory Variables and the Estimation of Causal Effects.

Abstract

Across the social sciences, lagged explanatory variables are a common strategy to confront challenges to causal identification using observational data. We show that "lag identification"--the use of lagged explanatory variables to solve endogeneity problems--is an illusion: lagging independent variables merely moves the channel through which endogeneity biases causal estimates, replacing a "selection on observables" assumption with an equally untestable "no dynamics among unobservables" assumption. We build our argument intuitively using directed acyclic graphs, then provide analytical results on the bias resulting from lag identification in a simple linear regression framework. We then present simulation results that characterize how, even under favorable conditions, lag identification leads to incorrect inferences. These findings have important implications for current practice among applied researchers in political science, economics, and related disciplines. We conclude by specifying the conditions under which lagged explanatory variables are appropriate for identifying causal effects.

• Item Type: MPRA Paper
• Language: English
• Keywords: Causal Identification, Treatment Effects, Lagged Variables
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C13 - Estimation: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C15 - Statistical Simulation Methods: General; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C21 - Cross-Sectional Models ; Spatial Models ; Treatment Effect Models ; Quantile Regressions

References

[1] Angrist, Joshua D., GuidoW. Imbens, and Donald B. Rubin (1996), “Identification of Causal Effects Using Instrumental Variables,” Journal of the American Statistical Association 91(434): 444-455.

[2] Angrist, Joshua D., and J¨orn-Steffen Pischke (2009), Mostly Harmless Econometrics, Princeton: Princeton University Press.

[3] Angrist, Joshua D., and J¨orn-Steffen Pischke (2010), “The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics,” Journal of Economic Perspectives 24(2): 3-30.

[4] Angrist, Joshua D., and J¨orn-Steffen Pischke (2014), Mastering ’Metrics, Princeton: Princeton University Press.

[5] Arellano, Manuel, and Stephen Bond (1991), “Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations, ” Review of Economic Studies 58(2): 277-297.

[6] Baccini, Leonardo, and Johannes Urpelainen (2014). “International Institutions and Domestic Politics: Can Preferential Trading Agreements Help Leaders Promote Economic Reform?, ” Journal of Politics 76(1): 195-214.

[7] Bertrand, Marianne, Esther Duflo, and Sendhil Mullainathan (2004), “How Much Should We Trust Differences-in-Differences Estimates?,” Quarterly Journal of Economics 119(1): 249-275.

[8] Blackwell, Matthew, and Adam Glynn (2014), “How to Make Causal Inferences with Time-Series Cross-Sectional Data,” Working Paper, Harvard University.

[9] Blundell, Richard, and Stephen Bond (1998), “Initial conditions and moment restrictions in dynamic panel data models,” Journal of Econometrics 87(1): 115-143.

[10] Bound, John, David Jaeger, and Regina Baker (1995), “ Problems with Instrumental Variables Estimation When the Correlation Between the Instruments and the Endogenous Explanatory Variable isWeak,” Journal of the American Statistical Association 90(430): 443-450.

[11] Christ, Carl F. (1994), “The Cowles Commission Contributions to Econometrics at Chicago: 1939–1955,” Journal of Economic Literature 32(1): 30-59.

[12] De Boef, Suzanna, and Luke Keele (2008), “Taking Time Seriously,” American Journal of Political Science 52(1): 184-200.

[13] Duflo, Esther, Rachel Glennerster, and Michael Kremer (2007), “Using Randomization in Development Economics Research: A Toolkit,” in T. Paul Schultz and John A. Strauss, Handbook of Development Economics, volume 4, Amsterdam: Elsevier-North Holland.

[14] Fitzgerald, Jennifer, David Lebland, and Jessica C. Teets (2014), “Defying the Law of Gravity: The Political Economy of International Migration,” World Politics 66(3): 406-445.

[15] Gerber, Alan S., and Donald P. Green (2012), Field Experiments: Design, Analysis, and Interpretation, New York: W.W. Norton & Company.

[16] Glennerster, Rachel, andKudzai Takavarasha (2013), Running Randomized Evaluations: A Practical Guide, Princeton, NJ: Princeton University Press.

[17] Haavelmo, Trygve (1943), “The Statistical Implications of a System of Simultaneous Equations,” Econometrica 11(1): 1-12.

[18] Harrison, GlennW., and John A. List (2004), “Field Experiments,” Journal of Economic Literature 42(4): 1009-1055.

[19] Imbens, GuidoW. (2014), “InstrumentalVariables: An Econometrician’s Perspective,” Working Paper, National Bureau of Economic Research.

[20] Imbens, GuidoW., and Thomas Lemieux (2008), “Regression Discontinuity Designs: A Guide to Practice,” Journal of Econometrics 142(2): 615-635.

[21] Kelley, Judith G., and Beth A. Simmons (forthcoming), “Politics by Number: Indicators as Social Pressure in International Relations,” American Journal of Political Science.

[22] Kellogg, Ryan (2014), “The Effect of Uncertainty on Investment: Evidence from Texas Oil Drilling,” American Economic Review 104(6): 1698-1734.

[23] Lehoucq, Fabrice, and Anibal P´erez-Li ˜n´an (2014), “ Breaking Out of the Coup Trap: Political Competition and Military Coups in Latin America,” Comparative Political Studies 47(8): 1105-1129.

[24] Nickell, Stephen (1981), “Biases in Dynamic Models with Fixed Effects,” Econometrica 49(6): 1417-1426.

[25] Pearl, Judea (2009), Causality, 2nd edition, Cambridge: Cambridge University Press.

[26] Pearl, Judea (forthcoming), “Trygve Haavelmo and the Emergence of Causal Calculus,” Econometric Theory.

[27] Reed,W. Robert (2014), “A Note on the Practice of Lagging Variables to Avoid Simultaneity,” W˙ orking Paper, University of Canterbury.

[28] Sekhon, Jasjeet S. (2009), “Opiates for the Matches: Matching Methods for Causal Inference,” Annual Review of Political Science 12:487–508.

[29] Steinberg, David A., and Krishna Malhotra (2014), “The Effect of Authoritarian Regime Type on Exchange Rate Policy,” World Politics 66(3): 491-529.

[30] Sovey, Allison J., and Donald P. Green (2011), “Instrumental Variables Estimation in Political Science: A Readers’ Guide,” American Journal of Political Science 55(1): 188- 200.

[31] Villas-Boas, J. Miguel, and Russell S. Winer (1999), “Endogeneity in Brand Choice Models,” Marketing Science 45(10): 1324-1338.

[32] Warren, T. Camber (2014), “ Not by the Sword Alone: Soft Power, Mass Media, and the Production of State Sovereignty,” International Organization 68(1): 111-141.