LADE-based inference for ARMA models with unspecified and heavy-tailed heteroscedastic noises

Zhu, Ke and Ling, Shiqing (2014): LADE-based inference for ARMA models with unspecified and heavy-tailed heteroscedastic noises.

Abstract

This paper develops a systematic procedure of statistical inference for the ARMA model with unspecified and heavy-tailed heteroscedastic noises. We first investigate the least absolute deviation estimator (LADE) and the self-weighted LADE for the model. Both estimators are shown to be strongly consistent and asymptotically normal when the noise has a finite variance and infinite variance, respectively. The rates of convergence of the LADE and the self-weighted LADE are $n^{-1/2}$ which is faster than those of LSE for the AR model when the tail index of GARCH noises is in (0,4], and thus they are more efficient in this case. Since their asymptotic covariance matrices can not be estimated directly from the sample, we develop the random weighting approach for statistical inference under this nonstandard case. We further propose a novel sign-based portmanteau test for model adequacy. Simulation study is carried out to assess the performance of our procedure and one real illustrating example is given.

• Item Type: MPRA Paper
• Language: English
• Keywords: ARMA(p,q) models; Asymptotic normality; Heavy-tailed noises; G/ARCH noises; LADE; Random weighting approach; Self-weighted LADE; Sign-based portmanteau test; Strong consistency.
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C12 - Hypothesis Testing: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C13 - Estimation: General

References

[1] BERKES, I.& HORVATH, L. (2004). The efficiency of the estimators of the parameters in GARCH processes. Annals of Statistics 32, 633-655.

[2] BOLLERSLEV, T. (1986). Generalized autoregressive conditional heteroskedasticity. Journal of Econometrics 31, 307-327.

[3] BROCKWELL, P.J. and DAVIS, R.A. (1991). Time Series: Theory and Methods. 2nd ed. Springer-Verlag, New York.

[4] CHAN, N.H. and PENG, L. (2005). Weighted least absolute deviation estimation for an AR(1) process with ARCH(1) errors. Biometrika 92, 477-484.

[5] CHAN, N.H. and WEI, C.Z. (1988). Limiting distributions of least squares estimates of unstable autoregressive processes. Annals of Statistics 16, 367-401.

[6] CHEN, K., GUO, S., LIN, Y., and YING, Z. (2010). Least absolute relative error estimation. Journal of the American Statistical Association 105, 1104-1112.

[7] CHEN, K., YING, Z., ZHANG, H., and ZHAO, L. (2008). Analysis of least absolute deviation. Biometrika 95, 107-122.

[8] DAVIS, R.A. (1996). Gauss-Newton and M-estimation for ARMA processes with infinite variance. Stochastic Processes and Their Applications 63, 75-95.

[9] DAVIS, R.A. and DUNSMUIR, W.T.M. (1997). Least absolute deviation estimation for regression with ARMA errors. Dedicated to Murray Rosenblatt. Journal of Theoretical Probability 10, 481-497.

[10] DAVIS, R.A., KNIGHT, K., and LIU, J. (1992). M-estimation for autoregressions with infinite variance. Stochastic Processes and their Application 40, 145-180.

[11] DAVIS, R.A., and MIKOSCH, T. (1998). The sample autocorrelations of heavy-tailed processes with applications to ARCH. Annals of Statistics 26, 2049-2080.

[12] ENGLE, R.F. (1982). Autoregressive conditional heteroskedasticity with estimates of variance of U.K. inflation. Econometrica 50, 987-1008.

[13] FAN, J. and YAO, Q. (2003). Nonlinear time series: Nonparametric and parametric methods. Springer, New York.

[14] FORNARI, F. and MELE, A. (1997). Sign- and volatility-switching ARCH models: theory and applications to international stock markets. Journal of Applied Econometrics 12, 1779-1801.

[15] FRANCQ, C. and ZAKOIAN, J.M. (2004). Maximum likelihood estimation of pure GARCH and ARMA-GARCH processes. Bernoulli 10, 605-637.

[16] FRANCQ, C. and ZAKOIAN, J.M. (2010). GARCH Models: Structure, Statistical Inference and Financial Applications. Wiley, Chichester, UK.

[17] FRANSES, P.H. and VAN DIJK, R. (1996). Forecasting stock market volatility using (non-linear) Garch models. Journal of Forecasting 15, 229-235.

[18] JIN, Z., YING, Z., and WEI, L.J. (2001). A simple resampling method by perturbing the minimand. Biometrika 88, 381-390.

[19] GLOSTEN, L.R., JAGANNATHAN, R., and RUNKLE, D. (1993). On the relation between the expected value and the volatility of the nominal excess return on stocks. Journal of Finance 48, 1779-1801.

[20] HE, C. and TERASVIRTA, T. (1999). Properties of moments of a family of GARCH processes. Journal of Econometrics 92, 173-192.

[21] HE, X., JURECKOVA, J., KOENKER, R. and PORTNOY, S. (1990). Tail behavior of regression estimators and their breakdown points. Econometrica 58, 1195-1214.

[22] HUBER, P.J. (1977). Robust Statistical Procedures. Philadelphia: Society for Industrial and Applied Mathematics.

[23] KNIGHT, K. (1987). Rate of convergence of centred estimates of autoregressive parameters for infinite variance autoregressions. Journal of Time Series Analysis 8, 51-60.

[24] KNIGHT, K. (1998). Limiting distributions for L1 regression estimators under general conditons. Annals of Statistics 26, 755-770.

[25] KOENKER, R.W. and BASSETT, G.W. (1978). Regression quantiles. Econometrica 46, 33-50.

[26] KOENKER, R.W. and BASSETT, G.W. (1982). Robust tests for heteroscedasticity based on regression quantiles. Journal of Econometrics 140 849-873.

[27] LANGE, T. (2011). Tail behavior and OLS estimation in AR-GARCH models. Statistica Sinica 21, 1191-1200.

[28] LI, G. and LI, W.K. (2008). Least absolute deviation estimation for fractionally integrated autoregressive moving average time series models with conditional heteroscedasticity. Biometrika 95, 399-414.

[29] LING, S. (2005). Self-weighted least absolute deviation estimation for infinite variance autoregressive models. Journal of the Royal Statistical Society B 67, 381-393.

[30] LING, S. (2007). Self-weighted and local quasi-maximum likelihood estimators for ARMA-GARCH/IGARCH models. Journal of Econometrics 140, 849-873.

[31] LING, S. and MCALEER, M. (2003). Asymptotic theory for a new vector ARMA-GARCH model. Econometric Theory 19, 280-310.

[32] LING, S. and MCALEER, M. (2010). A general asymptotic theory for time-series models. Statistica Neerlandica 64, 97-111.

[33] LJUNG, G.M. and BOX, G.E.P. (1978). On a measure of lack of fit in time series models. Biometrika 65, 297-303.

[34] LUCAS, A. (1995). Unit root tests based on M estimators. Econometric Theory 11, 331-346.

[35] MIKOSCH, T., GADRICH, T., KLUPPELBERG, C., and ADLER, R.J. (1995). Parameter estimation for ARMA models with infinite variance innovations. Annals of Statistics 23, 305-326.

[36] PAN, J., WANG, H. and YAO, Q. (2007). Weighted least absolute deviations estimation for ARMA models with infinite variance. Econometric Theory 23, 852-879.

[37] POLLARD, D. (1984). Convergence of stochastic processes. Springer, Berlin.

[38] ROBINSON, P.M. (1977). The estimation for a nonliear moving average model. Stochastic Processes and their Applications 5, 81-90.

[39] SCHWERT, G.W. (1989). Why does stock market volatility change over time? Journal of Finance 45, 1129-1155.

[40] TAYLOR, S. (1986). Modelling Financial Time Series. Wiley, New York.

[41] TIAO, G.C. and TSAY, R.S. (1989). Model specification in multivariate time series (with discussion). Journal of the Royal Statistical Society B 51, 157-213.

[42] TSAY, R.S. (1987). Conditional heteroscedastic time series models. Journal of the American Statistical Association 82, 590-604.

[43] TSAY, R.S. (2005). Analysis of financial time series (2nd ed.). New York: John Wiley & Sons, Incorporated.

[44] TSAY, R.S. and TIAO, G.C. (1990). Asymptotic properties of multivariate nonstationary processes with applications to autoregressions. Annals of Statistics 18, 220-250.

[45] WU, C.F.J. (1986). Jacknife, bootstrap and other resampling methods in regression analysis (with discussion). Annals of Statistics 14, 1261-1350.

[46] WU, R. and DAVIS, R.A. (2010). Least absolute deviation estimation for general autoregressive moving average time series models. Journal of Time Series Analysis 31, 98-112.

[47] YANG, M. and BEWLEY, R. (1995). Moving average conditional heteroskedastic processes. Economics Letters 49, 367-372.

[48] YAO, Q. and BROCKWELL, P.J. (2006). Gaussian maximum likelihood estimation for ARMA models I: Time series. Journal of Time Series Analysis 27, 857-875.

[49] ZAKOIAN, J.M. (1994). Threshold heteroskedastic models. Journal of Economic Dynamics and Control 18, 931-955.

[50] ZHANG, R.M. and LING, S. (2014). Asymptotic inference for AR models with heavy-tailed G-GARCH noises. Econometric Theory. Forthcoming.

[51] ZHANG, R.M., SIN, C.-Y. and LING, S. (2014). On functional limits of short- and long-memory linear processes with GARCH(1,1) noises. Revised for Stochastic Processes and their Applications.

[52] ZHU, K. and LI, W.K. (2013). A bootstrapped spectral test for adequacy in weak ARMA models. Submitted.

[53] ZHU, K. and LING, S. (2011). Global self-weighted and local quasi-maximum exponential likelihood estimators for ARMA-GARCH/IGARCH models. Annals of Statistics 39, 2131-2163.

[54] ZHU, K. and LING, S. (2012). The global weighted LAD estimators for finite/infinite variance ARMA(p,q) models. Econometric Theory 28, 1065-1086.

[55] ZHU, K. and LING, S. (2013). Quasi-maximum exponential likelihood estimators for a double AR(p) model. Statistica Sinica 23, 251-270.