MTest: a bootstrap test for multicollinearity

Morales-Oñate, Víctor and Morales-Oñate, Bolívar (2021): MTest: a bootstrap test for multicollinearity.

Abstract

A non parametric test based on bootstrap for detecting multicollinearity is proposed: MTest. This test gives statistical support to two of the most famous methods for detecting multicollinearity in applied work: Klein's rule and Variance Inflation Factor (VIF). Mtest lets the researcher set a statistical significance, or more precisely, an achieved significance level (ASL). In order to show the benefits of MTest, the procedure is computationally implemented in a function for linear regression models. These function is tested in numerical experiments that match the expected results. Finally, this paper makes an application of MTest to real data known to have multicollinearity problems and successfully detects multicollinearity with a given ASL.

• Item Type: MPRA Paper
• Language: English
• Keywords: MTest, Multicollinearity, Non Parametric Statistics, Simulation
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C13 - Estimation: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C15 - Statistical Simulation Methods: General

References

Achen, C. H. (1982). Interpreting and using regression. Sage.

Dinov, I. D. (2016). Methodological challenges and analytic opportunities for modeling and interpreting Big Healthcare Data.Gigascience, 5(1).

Efron, B. (1992). Bootstrap methods: another look at the jackknife. Breakthroughs in statistics (pp. 569-593). Springer, New York, NY.

Farrar, D. E., Glauber, R. R., (1967). Identities for negative moments of quadratic forms in normal variables. The Review of Economic and Statistics, 49, 92-107.

John Fox and Sanford Weisberg (2019). An R Companion to Applied Regression, Third Edition. Thousand Oaks CA: Sage. URL: https://socialsciences.mcmaster.ca/jfox/Books/Companion/

Gujarati, D. N., Porter, D. C., Gunasekar, S., (2012). Basic econometrics. McGraw-Hill, United States.

Horowitz, J. L. (2001). The bootstrap. In Handbook of econometrics (Vol. 5, pp. 3159-3228). Elsevier.

Imdadullah, M., Aslam, M., and Altaf, S. (2016). mctest: An R Package for Detection of Collinearity among Regressors. R J., 8(2), 495.

Jaya, I. G. N. M., Ruchjana, B., and Abdullah, A. (2020). Comparison Of Different Bayesian And Machine Learning Methods In Handling Multicollinearity Problem: A Monte Carlo Simulation Study. ARPN J. Eng. Appl. Sci, 15(18), 1998-2011.

Klein, L.R. (1962). An Introduction to Econometrics. Prentic-Hall, Englewood, Cliffs, N. J, 101.

Leamer, E. E., (1983). Model choice and specification analysis. Handbook of econometrics, 1, 285-330.

Longley, J. W. (1967). An appraisal of least squares programs for the electronic computer from the point of view of the user. Journal of the American Statistical association, 62(319), 819-841.

Marcoulides, K. M., and Raykov, T. (2019). Evaluation of variance inflation factors in regression models using latent variable modeling methods. Educational and psychological measurement, 79(5), 874-882.

The World Bank, (2021). World Development Indicators.

Salmerón-Gómez, R., García-García, C., and García-Pérez, J. (2021). A guide to using the r package “multicoll” for detecting multicollinearity. Computational Economics, 57(2), 529-536.

Venables, W. N. and Ripley, B. D. (2002) Modern Applied Statistics with S. Fourth Edition. Springer, New York. ISBN 0-387-95457-0

Stein, M.L., (1975). The detection of multicollinearity: A comment. The Review of Economics and Statistics, 366-368.