New Evidence on Linear Regression and Treatment Effect Heterogeneity

Słoczyński, Tymon (2012): New Evidence on Linear Regression and Treatment Effect Heterogeneity.

Abstract

In this paper I provide new evidence on the implications of treatment effect heterogeneity for least squares estimation when the effects are inappropriately assumed to be homogenous. I prove that under a set of benchmark assumptions linear regression provides a consistent estimator of the population average treatment effect on the treated times the population proportion of the nontreated individuals plus the population average treatment effect on the nontreated times the population proportion of the treated individuals. Consequently, in many empirical applications the linear regression estimates might not be close to any of the standard average treatment effects of interest.

• Item Type: MPRA Paper
• Language: English
• Keywords: treatment effects; linear regression; ordinary least squares; decomposition methods
• Subjects: C - Mathematical and Quantitative Methods > C3 - Multiple or Simultaneous Equation Models ; Multiple Variables > C31 - Cross-Sectional Models ; Spatial Models ; Treatment Effect Models ; Quantile Regressions ; Social Interaction Models; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C21 - Cross-Sectional Models ; Spatial Models ; Treatment Effect Models ; Quantile Regressions; C - Mathematical and Quantitative Methods > C0 - General > C01 - Econometrics

References

Abadie, A., Angrist, J., and Imbens, G. (2002), „Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings,” Econometrica, 70, 91–117.

Abadie, A., and Imbens, G. W. (2006), „Large Sample Properties of Matching Estimators for Average Treatment Effects,” Econometrica, 74, 235–267.

Abadie, A., and Imbens, G. W. (2011), „Bias-Corrected Matching Estimators for Average Treatment Effects,” Journal of Business & Economic Statistics, 29, 1–11.

Angrist, J. D. (1998), „Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants,” Econometrica, 66, 249–288.

Angrist, J. D., and Krueger, A. B. (1999), „Empirical Strategies in Labor Economics,” in Handbook of Labor Economics (Vol.~3), eds.~O. Ashenfelter and D. Card, Amsterdam: Elsevier.

Angrist, J. D., and Pischke, J.-S. (2009), Mostly Harmless Econometrics: An Empiricist's Companion, Princeton and Oxford: Princeton University Press.

Barsky, R., Bound, J., Charles, K. K., and Lupton, J. P. (2002), „Accounting for the Black-White Wealth Gap: A Nonparametric Approach,” Journal of the American Statistical Association, 97, 663–673.

Bitler, M. P., Gelbach, J. B., and Hoynes, H. W. (2006), „What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments,” American Economic Review, 96, 988–1012.

Bitler, M. P., Gelbach, J. B., and Hoynes, H. W. (2008), „Distributional Impacts of the Self-Sufficiency Project,” Journal of Public Economics, 92, 748–765.

Black, D. A., Smith, J. A., Berger, M. C., and Noel, B. J. (2003), „Is the Threat of Reemployment Services More Effective than the Services Themselves? Evidence from Random Assignment in the UI System,” American Economic Review, 93, 1313–1327.

Blinder, A. S. (1973), „Wage Discrimination: Reduced Form and Structural Estimates,” Journal of Human Resources, 8, 436–455.

Blundell, R., and Costa Dias, M. (2009), „Alternative Approaches to Evaluation in Empirical Microeconomics,” Journal of Human Resources, 44, 565–640.

Chernozhukov, V., and Hansen, C. (2005), „An IV Model of Quantile Treatment Effects,” Econometrica, 73, 245–261.

Cotton, J. (1988), „On the Decomposition of Wage Differentials,” Review of Economics and Statistics, 70, 236–243.

Crump, R. K., Hotz, V. J., Imbens, G. W., and Mitnik, O. A. (2008), „Nonparametric Tests for Treatment Effect Heterogeneity,” Review of Economics and Statistics, 90, 389–405.

Dehejia, R. H., and Wahba, S. (1999), „Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training Programs,” Journal of the American Statistical Association, 94, 1053–1062.

Djebbari, H., and Smith, J. (2008), „Heterogeneous Impacts in PROGRESA,” Journal of Econometrics, 145, 64–80.

Elder, T. E., Goddeeris, J. H., and Haider, S. J. (2010), „Unexplained Gaps and Oaxaca-Blinder Decompositions,” Labour Economics, 17, 284–290.

Firpo, S. (2007), „Efficient Semiparametric Estimation of Quantile Treatment Effects,” Econometrica, 75, 259–276.

Fortin, N., Lemieux, T., and Firpo, S. (2011), „Decomposition Methods in Economics,” in Handbook of Labor Economics (Vol.~4), eds.~O. Ashenfelter and D. Card, San Diego and Amsterdam: Elsevier.

Frölich, M., and Melly, B. (2008), „Unconditional Quantile Treatment Effects under Endogeneity,” IZA Discussion Paper 3288, Institute for the Study of Labor (IZA).

Fryer, R. G., and Levitt, S. D. (2004), „Understanding the Black-White Test Score Gap in the First Two Years of School,” Review of Economics and Statistics, 86, 447–464.

Heckman, J. J. (2001), „Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture,” Journal of Political Economy, 109, 673–748.

Heckman, J. J., and Hotz, V. J. (1989), „Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training,” Journal of the American Statistical Association, 84, 862–874.

Heckman, J. J., Smith, J., and Clements, N. (1997), „Making the Most out of Programme Evaluations and Social Experiments: Accounting for Heterogeneity in Programme Impacts,” Review of Economic Studies, 64, 487–535.

Hirano, K., Imbens, G. W., and Ridder, G. (2003), „Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score,” Econometrica, 71, 1161–1189.

Humphreys, M. (2009), „Bounds on Least Squares Estimates of Causal Effects in the Presence of Heterogeneous Assignment Probabilities,” unpublished manuscript, Columbia University.

Imbens, G. W., and Wooldridge, J. M. (2009), „Recent Developments in the Econometrics of Program Evaluation,” Journal of Economic Literature, 47, 5–86.

Jann, B. (2008), „The Blinder-Oaxaca Decomposition for Linear Regression Models,” Stata Journal, 8, 453–479.

Kline, P. (2011), „Oaxaca-Blinder as a Reweighting Estimator,” American Economic Review, 101, 532–537.

LaLonde, R. J. (1986), „Evaluating the Econometric Evaluations of Training Programs with Experimental Data,” American Economic Review, 76, 604–620.

Løken, K. V., Mogstad, M., and Wiswall, M. (2012), „What Linear Estimators Miss: The Effects of Family Income on Child Outcomes,” American Economic Journal: Applied Economics, 4, 1–35.

Melly, B. (2006), „Applied Quantile Regression,” unpublished Ph.D. dissertation, University of St. Gallen.

Neal, D. A., and Johnson, W. R. (1996), „The Role of Premarket Factors in Black-White Wage Differences,” Journal of Political Economy, 104, 869–895.

Oaxaca, R. (1973), „Male-Female Wage Differentials in Urban Labor Markets,” International Economic Review, 14, 693–709.

Rosenbaum, P. R., and Rubin, D. B. (1983), „The Central Role of the Propensity Score in Observational Studies for Causal Effects,” Biometrika, 70, 41–55.

Smith, J. A., and Todd, P. E. (2005), „Does Matching Overcome LaLonde’s Critique of Nonexperimental Estimators?,” Journal of Econometrics, 125, 305–353.

Wooldridge, J. M. (2010), Econometric Analysis of Cross Section and Panel Data (2nd ed.), Cambridge and London: MIT Press.

Yitzhaki, S. (1996), „On Using Linear Regressions in Welfare Economics,” Journal of Business & Economic Statistics, 14, 478–486.