Bootstrap Tests Based on Goodness-of-Fit Measures for Nonnested Hypotheses in Regression Models

Jeong, Jinook (2006): Bootstrap Tests Based on Goodness-of-Fit Measures for Nonnested Hypotheses in Regression Models.

Abstract

This paper utilizes the bootstrap to construct tests using the measures for goodness-of-fit for nonnested regression models. The bootstrap enables us to compute the statistical significance of the differences in the measures and to formally test on nonnested regression models. The bootstrap tests that this paper proposes are expected to show better finite sample properties since they do not have accumulated errors in the computation process. Moreover, the bootstrap tests remove the possibility of inconsistent test results that the previous tests suffer from. Because the bootstrap tests only evaluate if a model has a significantly higher explanatory power than the other model, there is no possibility for inconsistent results. This study presents Monte Carlo simulation results to compare the finite sample properties of the proposed tests with the previous tests such as Cox test and J-test.

• Item Type: MPRA Paper
• Language: English
• Keywords: nonnested regression models, bootstrap, goodness-of-fit measures
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C14 - Semiparametric and Nonparametric Methods: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C12 - Hypothesis Testing: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C15 - Statistical Simulation Methods: General

References

Cox, D.R. (1961), "Test of Seperate Families of Hypotheses," Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability 1, pp.105-123

Cox, D.R. (1962), "Further Results on Tests of Separate Families of Hypotheses," Journal of the Royal Statistical Society 24, pp.406-24

Cramer, J.S. (1987), “Mean and Variance of R2 in Small and Moderate Samples,” Journal of Econometrics 35, pp.253-266

Davidson, R. and J.G. MacKinnon (1981), "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica 49 , pp.781-793

Davidson, R. and J.G. MacKinnon (2002), "Bootstrap J Tests of Non-nested Linear Regression Models," Journal of Econometrics 109 , pp.167-193

Davidson, R. and J.G. MacKinnon (2004), Econometric Theory and Methods, Oxford University Press, New York.

Ebbeler, D.H. (1975), “On the Probability of Correct Model Selection Using the Maximum Choice Criterion,” International Economic Review 16, pp.516-520.

Fan, Y. and Q. Li (1995), "Bootstrapping J-type Tests for Non-nested Regrssion Models," Economics Letters 48 , pp.107-112

Godfrey, L.G. (1998), "Tests of Non-nested Regression models : Some Results on Small Sample Behaviour and the Bootstrap," Journal of Econometrics 84 , pp.59-74

Jeong, J. and S. Chung (2001), "Bootstrap Tests for Autocorrelation," Computational Statistics and Data Analysis 38, pp.49-69.

Jeong, J. and G.S. Maddala (1993), "A Perspective on Application of Bootstrap Methods in Econometrics," Handbook of Statistics, Volume 11: Econometrics, North-Holland, (ed) by G.S. Maddala, C.R. Rao, and H.D. Vinod, pp.573-610.

Kinal, T. and K. Lahiri (1984), “A Note on ‘Selection of Regressors,’” International Economic Review 25, pp.625-629.

McAleer, M. (1984), "Specification Tests for Separate Models: A Survey," in M.L. King and D.E.A. Giles (eds), Specification Analysis in the Linear Model: Essays in Honor of Donald Cochrane

Mizon, G.E. and J.F. Richard (1986), "The Encompassing Principle and its Application to Testing Non-nested Hypotheses," Econometrica 54 , pp.657-678

Pagan, A. (1984), "Econometric issues in the analysis of regressions with generated regressors," International Economic Review 25, pp.221-247.

Pagan, A. (1986), "Two stage and related estimators and their applications," Review of Economic Studies 53, pp.517-538

Pesaran, M.H. (1974), "On the General Problem of Model Selection," Review of Economic Studies 41 , pp.153-171

Pesaran, M.H. and A.S. Deaton (1978), "Testing Non-nested Nonlinear Regression Models," Econometrica 46 , pp.677-694

Pesaran, M.H. (1982), "Comparison of Local Power of Alternative Tests of Nonnested Regression Models," Econometrica 50, pp.1287-1306

Schmidt, P. (1973), “Calculating the Power of the Minimum Standard Error Choice Criterion,” International Economic Review 14, pp.253-255.