A Power Booster Factor for Out-of-Sample Tests of Predictability

Pincheira, Pablo (2017): A Power Booster Factor for Out-of-Sample Tests of Predictability.

Abstract

In this paper we introduce a “power booster factor” for out-of-sample tests of predictability. The relevant econometric environment is one in which the econometrician wants to compare the population Mean Squared Prediction Errors (MSPE) of two models: one big nesting model, and another smaller nested model. Although our factor can be used to improve the power of many out-of-sample tests of predictability, in this paper we focus on boosting the power of the widely used test developed by Clark and West (2006, 2007). Our new test multiplies the Clark and West t-statistic by a factor that should be close to one under the null hypothesis that the short nested model is the true model, but that should be greater than one under the alternative hypothesis that the big nesting model is more adequate. We use Monte Carlo simulations to explore the size and power of our approach. Our simulations reveal that the new test is well sized and powerful. In particular, it tends to be less undersized and more powerful than the test by Clark and West (2006, 2007). Although most of the gains in power are associated to size improvements, we also obtain gains in size-adjusted power. Finally we present an empirical application in which more rejections of the null hypothesis are obtained with our new test.

• Item Type: MPRA Paper
• Language: English
• Keywords: Time-series, forecasting, inference, inflation, exchange rates, random walk, out-of-sample
• Subjects: C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C22 - Time-Series Models ; Dynamic Quantile Regressions ; Dynamic Treatment Effect Models ; Diffusion Processes; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C52 - Model Evaluation, Validation, and Selection; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C53 - Forecasting and Prediction Methods ; Simulation Methods; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C58 - Financial Econometrics; E - Macroeconomics and Monetary Economics > E1 - General Aggregative Models > E17 - Forecasting and Simulation: Models and Applications; E - Macroeconomics and Monetary Economics > E2 - Consumption, Saving, Production, Investment, Labor Markets, and Informal Economy > E27 - Forecasting and Simulation: Models and Applications; E - Macroeconomics and Monetary Economics > E3 - Prices, Business Fluctuations, and Cycles > E37 - Forecasting and Simulation: Models and Applications; E - Macroeconomics and Monetary Economics > E4 - Money and Interest Rates > E47 - Forecasting and Simulation: Models and Applications; F - International Economics > F3 - International Finance > F37 - International Finance Forecasting and Simulation: Models and Applications

References

1. CAMPBELL, J.Y., 2001. “Why long horizons? A study of power against persistent alternatives”. Journal of Empirical Finance 8, 459–491.

2. CICCARELLI, M. and B. MOJON, 2010. “Global Inflation.” The Review of Economics and Statistics 92(3), pp. 524-535.

3. CHEN, Y., K.S. ROGOFF and B. ROSSI, 2010. “Can Exchange Rates Forecast Commodity Prices?”, The Quarterly Journal of Economics vol. 125(3), pp. 595-620.

4. CLARK, T. and M. McCRACKEN, 2001. “Tests of equal forecast accuracy and encompassing for nested models”. Journal of Econometrics 105, 85–110.

5. CLARK, T. and M. McCRACKEN, 2005. “Evaluating direct multistep forecasts”. Econometric Reviews 24, 369–404.

6. CLARK, T. and M. McCRACKEN, 2013, “Evaluating the Accuracy of Forecasts from Vector Autoregressions,” in T. Fomby, L. Killian, and A. Murphy (ed), Vector Autoregressive Modeling—New Developments and Applications: Essays in Honor of Christopher A. Sims, Bingley: Emerald Group Publishing.

7. CLARK, T. and K.D. WEST, 2006. “Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference Hypothesis.” Journal of Econometrics 135(1-2), pp. 155-186.

8. CLARK, T. and K.D. WEST, 2007. “Approximately Normal Tests for Equal Predictive Accuracy in Nested Models.” Journal of Econometrics 138, pp. 291-311.

9. DIEBOLD, F. and R. MARIANO, 1995. “Comparing Predictive Accuracy”. Journal of Business and Economic Statistics 13(3). pp. 253-263.

10. GIACOMINI R. and H. WHITE, 2006, “Tests of conditional predictive ability,” Econometrica 74: 1545–1578.

11. HAKKIO, C., 2009, “Global Inflation Dynamics”, Research Working Paper 09-01, Federal Reserve Bank of Kansas City.

12. HAMILTON, J., 1994, Time Series Analysis, Princeton University Press.

13. INOUE A. and L. Kilian, 2005, “In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?” Econometric Reviews 23(4): 371-402.

14. MANKIW, N.G., SHAPIRO, M.D., 1986. Do we reject too often? Small sample properties of tests of rational expectations models. Economics Letters 20, 139–145.

15. McCRACKEN, M 2007. “Asymptotics for out of sample tests of Granger causality”. Journal of Econometrics 140(2), 719–752.

16. MEDEL, C., M. PEDERSEN and P.PINCHEIRA, 2016. “The Elusive Predictive Ability of Global Inflation”, International Finance, 19(2): 120-146.

17. MORALES-ARIAS, L. AND G.V. MOURA, 2013, “A Conditional Heteroskedastic Global Inflation Model”, Journal of Economic Studies 40(4): 572-596.

18. NELSON, C.R., KIM, M.J., 1993. Predictable stock returns: the role of small sample bias. Journal of Finance 48, 641–661.

19. NEWEY, W.K. and K. WEST, 1987. “A Simple, Positive, Semi-Definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix.” Econometrica 55 (3): 703-8.

20. NEWEY, W.K. and K.D. WEST, 1994. “Automatic lag selection in covariance matrix estimation”. Review of Economic Studies 61, 631–654.

21. PINCHEIRA, P. and A. GATTY, 2016. “Forecasting Chilean Inflation with International Factors.”, Empirical Economics, 51(3): 981-1010.

22. PINCHEIRA, P. M, 2013. “Shrinkage Based Tests of Predictability.” Journal of Forecasting, 32(4), 307–332.

23. PINCHEIRA, P. M. and WEST, K. D., 2016. “A comparison of some out-of-sample tests of predictability in iterated multi-step-ahead forecasts.” Research in Economics, 70(2), 304–319.

24. STAMBAUGH, R.F., 1999. Predictive regressions. Journal of Financial Economics 54, 375–421.

25. TAUCHEN, G., 2001. The bias of tests for a risk premium in forward exchange rates. Journal of Empirical Finance 8, 695–704.

26. WEST, K.D., 1996, “Asymptotic Inference about Predictive Ability” Econometrica 64(5) pp.1067-84.

27. WEST, K.D., 2006, “Forecast Evaluation”, 100-134 in Handbook of Economic Forecasting, Vol. 1, G. Elliott, C. Granger and A. Timmerman (eds), Amsterdam: Elsevier (2006).

28. WHITE H. 2001. Asymptotic Theory for Econometricians. Revised Edition. Academic Press.