Model Averaging in Predictive Regressions

Liu, Chu-An and Kuo, Biing-Shen (2016): Model Averaging in Predictive Regressions.

Abstract

This paper considers forecast combination in a predictive regression. We construct the point forecast by combining predictions from all possible linear regression models given a set of potentially relevant predictors. We derive the asymptotic risk of least squares averaging estimators in a local asymptotic framework. We then develop a frequentist model averaging criterion, an asymptotically unbiased estimator of the asymptotic risk, to select forecast weights. Monte Carlo simulations show that our averaging estimator compares favorably with alternative methods such as weighted AIC, weighted BIC, Mallows model averaging, and jackknife model averaging. The proposed method is applied to stock return predictions.

• Item Type: MPRA Paper
• Language: English
• Keywords: Forecast combination, Local asymptotic theory, Plug-in estimators.
• Subjects: C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C52 - Model Evaluation, Validation, and Selection; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C53 - Forecasting and Prediction Methods ; Simulation Methods

References

Andrews, D. W. K. (1991): “Asymptotic Optimality of Generalized CL, Cross-Validation, and Generalized Cross-Validation in Regression with Heteroskedastic Errors,” Journal of Econometrics, 47, 359–377.

Bates, J. and C. Granger (1969): “The Combination of Forecasts,” Operational Research Quarterly, 20, 451–468.

Breiman, L. (1996): “Bagging Predictors,” Machine learning, 24, 123–140.

Buckland, S., K. Burnham, and N. Augustin (1997): “Model Selection: An Integral Part of Inference,” Biometrics, 53, 603–618.

Cheng, X. and B. E. Hansen (2015): “Forecasting with Factor-Augmented Regression: A Frequentist Model Averaging Approach,” Journal of Econometrics, 186, 280–293.

Claeskens, G. and R. J. Carroll (2007): “An Asymptotic Theory for Model Selection Inference in General Semiparametric Problems,” Biometrika, 94, 249–265.

Claeskens, G. and N. L. Hjort (2003): “The Focused Information Criterion,” Journal of the American Statistical Association, 98, 900–916.

——— (2008): “Minimizing Average Risk in Regression Models,” Econometric Theory, 24, 493–527.

Clark, T. and K. West (2007): “Approximately Normal Tests for Equal Predictive Accuracy in Nested Models,” Journal of Econometrics, 138, 291–311.

Clemen, R. (1989): “Combining Forecasts: A Review and Annotated Bibliography,” International Journal of Forecasting, 5, 559–583.

DiTraglia, F. (2015): “Using Invalid Instruments on Purpose: Focused Moment Selection and Averaging for GMM,” Working Paper, University of Pennsylvania.

Elliott, G., A. Gargano, and A. Timmermann (2013): “Complete Subset Regressions,” Journal of Econometrics, 177, 357–373.

Granger, C. (1989): “Combining Forecasts–Twenty Years Later,” Journal of Forecasting, 8, 167–173.

Granger, C. and R. Ramanathan (1984): “Improved Methods of Combining Forecasts,” Journal of Forecasting, 3, 197–204.

Hansen, B. E. (2007): “Least Squares Model Averaging,” Econometrica, 75, 1175–1189.

——— (2008): “Least-Squares Forecast Averaging,” Journal of Econometrics, 146, 342–350.

——— (2010): “Multi-Step Forecast Model Selection,” Working Paper, University of Wisconsin.

——— (2014): “Model Averaging, Asymptotic Risk, and Regressor Groups,” Quantitative Economics, 5, 495–530.

——— (2016): “Efficient Shrinkage in Parametric Models,” Journal of Econometrics, 190, 115–132.

Hansen, B. E. and J. Racine (2012): “Jackknife Model Averaging,” Journal of Econometrics, 167, 38–46.

Hansen, P., A. Lunde, and J. Nason (2011): “The Model Confidence Set,” Econometrica, 79, 453–497.

Hjort, N. L. and G. Claeskens (2003): “Frequentist Model Average Estimators,” Journal of the American Statistical Association, 98, 879–899.

Ing, C.-K. and C.-Z. Wei (2005): “Order Selection for Same-Realization Predictions in Autoregressive Processes,” The Annals of Statistics, 33, 2423–2474.

Inoue, A. and L. Kilian (2008): “How Useful is Bagging in Forecasting Economic Time Series? A Case Study of US Consumer Price Inflation,” Journal of the American Statistical Association, 103, 511–522.

Kim, J. and D. Pollard (1990): “Cube Root Asymptotics,” The Annals of Statistics, 18, 191–219.

Kitagawa, T. and C. Muris (2015): “Model Averaging in Semiparametric Estimation of Treatment Effects,” Cemmap Working Paper.

Leeb, H. and B. P¨otscher (2005): “Model Selection and Inference: Facts and Fiction,” Econometric Theory, 21, 21–59.

Li, K.-C. (1987): “Asymptotic Optimality for Cp, CL, Cross-Validation and Generalized Cross-Validation: Discrete Index Set,” The Annals of Statistics, 15, 958–975.

Liu, C.-A. (2015): “Distribution Theory of the Least Squares Averaging Estimator,” Journal of Econometrics, 186, 142–159.

Liu, Q. and R. Okui (2013): “Heteroscedasticity-Robust Cp Model Averaging,” The Econometrics Journal, 16, 463–472.

Lu, X. (2015): “A Covariate Selection Criterion for Estimation of Treatment Effects,” Journal of Business & Economic Statistics, 33, 506–522.

Min, C.-K. and A. Zellner (1993): “Bayesian and Non-Bayesian Methods for Combining Models and Forecasts with Applications to Forecasting International Growth Rates,” Journal of Econometrics, 56, 89–118.

Ng, S. (2013): “Variable Selection in Predictive Regressions,” in Handbook of Economic Forecasting, ed. by G. Elliott and A. Timmermann, Elsevier, vol. 2, chap. 14, 752–789.

P¨otscher, B. (2006): “The Distribution of Model Averaging Estimators and an Impossibility Result Regarding its Estimation,” Lecture Notes-Monograph Series, 52, 113–129.

Raftery, A., D. Madigan, and J. Hoeting (1997): “Bayesian Model Averaging for Linear Regression Models,” Journal of the American Statistical Association, 92, 179–191.

Rapach, D., J. Strauss, and G. Zhou (2010): “Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy,” Review of Financial Studies, 23, 821–862.

Rapach, D. and G. Zhou (2012): “Forecasting Stock Returns,” in Handbook of Economic Forecasting, Elsevier, vol. 2.

Shao, J. (1997): “An Asymptotic Theory for Linear Model Selection,” Statistica Sinica, 7, 221–242.

Shibata, R. (1980): “Asymptotically Efficient Selection of the Order of the Model for Estimating Parameters of a Linear Process,” The Annals of Statistics, 8, 147–164.

Staiger, D. and J. Stock (1997): “Instrumental Variables Regression with Weak Instruments,” Econometrica, 65, 557–586.

Stock, J. H. and M. W. Watson (2006): “Forecasting with Many Predictors,” in Handbook of Economic Forecasting, ed. by G. Elliott, C. Granger, and A. Timmermann, Elsevier, vol. 1, 515–554.

Sueishi, N. (2013): “Generalized Empirical Likelihood-Based Focused Information Criterion and Model Averaging,” Econometrics, 1, 141–156.

Tibshirani, R. (1996): “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society. Series B (Methodological), 58, 267–288.

Timmermann, A. (2006): “Forecast Combinations,” in Handbook of Economic Forecasting, ed. by G. Elliott, C. Granger, and A. Timmermann, Elsevier, vol. 1, 135–196.

Van der Vaart, A. and J. Wellner (1996): Weak Convergence and Empirical Processes, Springer Verlag.

Wan, A., X. Zhang, and G. Zou (2010): “Least Squares Model Averaging by Mallows Criterion,” Journal of Econometrics, 156, 277–283.

Welch, I. and A. Goyal (2008): “A Comprehensive Look at the Empirical Performance of Equity Premium Prediction,” Review of Financial Studies, 21, 1455–1508.

White, H. (1980): “A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity,” Econometrica, 48, 817–838.

Yang, Y. (2004): “Combining Forecasting Procedures: Some Theoretical Results,” Econometric Theory, 20, 176–222.

——— (2007): “Prediction/Estimation with Simple Linear Models: Is it Really that Simple?” Econometric Theory, 23, 1–36.

Zhang, X. and H. Liang (2011): “Focused Information Criterion and Model Averaging for Generalized Additive Partial Linear Models,” The Annals of Statistics, 39, 174–200.

Zhang, X., A. T. Wan, and S. Z. Zhou (2012): “Focused Information Criteria, Model Selection, and Model Averaging in a Tobit Model with a Nonzero Threshold,” Journal of Business & Economic Statistics, 30, 132–142.

Zhang, X., A. T. Wan, and G. Zou (2013): “Model Averaging by Jackknife Criterion in Models with Dependent Data,” Journal of Econometrics, 174, 82–94.

Zhang, X., G. Zou, and H. Liang (2014): “Model Averaging and Weight Choice in Linear Mixed-Effects Models,” Biometrika, 101, 205–218.

Zou, H. (2006): “The Adaptive Lasso and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429.

Zou, H. and Y. Yang (2004): “Combining Time Series Models for Forecasting,” International Journal of Forecasting, 20, 69–84.