Normal versus Noncentral Chi-square Asymptotics of Misspecified Models

Chun, So Yeon and Alexander, Shapiro (2009): Normal versus Noncentral Chi-square Asymptotics of Misspecified Models. Forthcoming in: multivariate behavioral research

Abstract

The noncentral chi-square approximation of the distribution of the likelihood ratio (LR) test statistic is a critical part of the methodology in structural equations modeling (SEM). Recently, it was argued by some authors that in certain situations normal distributions may give a better approximation of the distribution of the LR test statistic. The main goal of this paper is to evaluate the validity of employing these distributions in practice. Monte Carlo simulation results indicate that the noncentral chi-square distribution describes behavior of the LR test statistic well under small, moderate and even severe misspecifications regardless of the sample size (as long as it is sufficiently large), while the normal distribution, with a bias correction, gives a slightly better approximation for extremely severe misspecifications. However, neither the noncentral chi-square distribution nor the theoretical normal distributions give a reasonable approximation of the LR test statistics under extremely severe misspecifications. Of course, extremely misspecified models are not of much practical interest.

• Item Type: MPRA Paper
• Language: English
• Keywords: Model misspecification; covariance structure analysis; maximum likelihood; generalized least squares; discrepancy function; noncentral chi-square distribution; normal distribution; factor analysis
• Subjects: C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C52 - Model Evaluation, Validation, and Selection; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C12 - Hypothesis Testing: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C15 - Statistical Simulation Methods: General

References

Browne, M. W. (1974). Generalized least squares estimators in the analysis of covariance structures. South African Statistical Journal , 8 , 1-24.

Browne, M. W., & Cudeck, R. (1992). Alternative methods of assessing model fit. Sociological Methods and Research, 21 , 230-258.

Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models. (pp. 136–162). Beverly Hills, CA : Sage.

Browne, M. W., & Shapiro, A. (1988). Robustness of normal theory methods in the analysis of linear latent variate models. British Journal of Mathematical and Statistical Psychology, 41 , 193-208.

Chun, S. Y., & Shapiro, A. (2008). Construction of covariance matrices with a specified discrepancy function minimizer, with application to factor analysis. (E-print available at http://www.optimization-online.org)

Cudeck, R., & Browne, M. W. (1992). Constructing a covariance matrix that yields a specified minimizer and a specified minimum discrepancy function value. Psychometrika, 57 , 357–369.

Efron, B., & Tibshirami, R. (1993). An introduction to the bootstrap. New York :Chapman and Hall.

Golden, R. M. (2003). Discrepancy risk model selection test theory for comparing possibly misspecified or nonnested models. Psychometrika, 68 , 229–249.

McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, N.J. : L. Erlbaum Associates.

McManus, D. A. (1991). Who invented local power analysis? Econometric Theory, 7, 265–268.

Muirhead, R. J., & Waternaux, C. M. (1980). Asymptotic distributions in canonical correlation analysis and other multivariate procedures for nonnormal populations. Biometrika, 67 , 31–43.

Olsson, U. H., Foss, T., & Breivik, E. (2004). Two equivalent discrepancy functions for maximum likelihood estimation: do their test statistics follow a non-central chi-square distribution under model misspecification? Sociological Methods Res., 32 , 453–500.

Shapiro, A. (1983). Asymptotic distribution theory in the analysis of covariance structures (a unified approach). South African Statistical Journal, 17 , 33–81.

Shapiro, A. (2009). Asymptotic normality of test statistics under alternative hypotheses. Journal of Multivariate Analysis, 100 , 936–945.

Shapiro, A., & Browne, M. W. (1987). Analysis of covariance structures under elliptical distributions. Journal of the American Statistical Association, 82 , 1092-1097.

Steiger, J., & Lind, J. (1980). Statistically based tests for the number of common factors. (Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA)

Steiger, J. H., Shapiro, A., & Browne, M. W. (1985). On the multivariate asymptoticdistribution of sequential chi-square statistics. Psychometrika, 50 , 253–264.

Sugawara, H. M., & MacCallum, R. C. (1993). Effect of estimation method on incremental fit indexes for covariance structure models. Applied Psychological Measurement , 17 , 365–377.

Thurstone, L. L., & Thurstone, T. G. (1941). Factorial studies of intelligence. Chicago, Il: The University of Chicago Press.

Vuong, Q. H. (1989). Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica, 57 , 307–333.

Wilks, S. S. (1938). The large sample distribution of the likelihood ratio for testing composite hypotheses. Annals of Mathematical Statistics, 9 , 60–62.

Yuan, K. H. (2008). Noncentral chi-square versus normal distributions in describing the likelihood ratio statistic: the univariate case and its multivariate implication. Multivariate Behavioral Research, 43 , 109–136.

Yuan, K. H., Hayashi, K., & Bentler, P. M. (2007). Normal theory likelihood ratio statistic for mean and covariance structure analysis under alternative hypotheses. Journal of Multivariate Analysis, 98 , 1262–1282.