Penalized Convex Estimation in Dynamic Location-Scale models

ALAMI CHENTOUFI, Reda (2024): Penalized Convex Estimation in Dynamic Location-Scale models.

Abstract

This paper introduces a two-step procedure for convex penalized estimation in dynamic location-scale models. The method uses a consistent, non-sparse first-step estimator to construct a convex Weighted Least Squares (WLS) optimization problem compatible with the Least Absolute Shrinkage and Selection Operator (LASSO), addressing challenges associated with non-convexity and enabling efficient, sparse estimation.

The consistency and asymptotic distribution of the estimator are established, with finite-sample performance evaluated through Monte Carlo simulations. The method's practical utility is demonstrated through an application to electricity prices in France, Belgium, the Netherlands, and Switzerland, effectively capturing seasonal patterns and external covariates while ensuring model sparsity.

• Item Type: MPRA Paper
• Language: English
• Keywords: Weighted LSE; LASSO estimation; variable selection; GARCH models
• Subjects: C - Mathematical and Quantitative Methods > C0 - General > C01 - Econometrics; C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C22 - Time-Series Models ; Dynamic Quantile Regressions ; Dynamic Treatment Effect Models ; Diffusion Processes; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C51 - Model Construction and Estimation; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C52 - Model Evaluation, Validation, and Selection; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C58 - Financial Econometrics

References

Adamek, R., Smeekes, S., Wilms, I., 2023. Lasso inference for high-dimensional time series. Journal of Econometrics 235, 1114–1143.

Akaike, H., 1974. A new look at the statistical model identification. IEEE Transactions on Automatic Control 19, 716–723.

Akaike, H., 1998. Information theory and an extension of the maximum likelihood principle, in: Parzen, E., Tanabe, K., Kitagawa, G. (Eds.), Selected Papers of Hirotugu Akaike. Springer, pp. 199–213.

Aknouche, A., Francq, C., 2023. Two-stage weighted least squares estimator of the conditional mean of observation-driven time series models. Journal of Econometrics 237, 105174.

Andrews, D.W.K., 1999. Estimation when a parameter is on a boundary. Econometrica 67, 1341–1383.

Billingsley, P., 1961. The lindeberg-levy theorem for martingales. Proceedings of the American Mathematical Society 12, 788–792.

Bollerslev, T., 1986. Generalized autoregressive conditional heteroskedasticity. Journal of Econometrics 31, 307–327.

Bunea, F., Tsybakov, A., Wegkamp, M., 2007. Sparsity oracle inequalities for the lasso. Electronic Journal of Statistics 1, 169–194.

Chan, K.S., Chen, K., 2011. Subset arma selection via the adaptive lasso. Statistics and Its Interface 4, 197–205.

Chan, N.H., Ling, S., Yau, C.Y., 2020. Lasso-based variable selection of arma models. Statistica Sinica 30, 1925–1948.

Chan, N.H., Yau, C.Y., Zhang, R.M., 2015. Lasso estimation of threshold autoregressive models. Journal of Econometrics 189, 285–296.

Davis, R.A., Knight, K., Liu, J., 1992. M-estimation for autoregressions with infinite variance. Stochastic Processes and Their Applications 40, 145–180.

Efron, B., Hastie, T., Johnstone, I., Tibshirani, R., 2004. Least angle regression. The Annals of Statistics 32, 407–499.

Engle, R.F., 1982. Autoregressive conditional heteroscedasticity with estimates of the variance of united kingdom inflation. Econometrica 50, 987–1007.

Fan, J., Peng, H., 2004. Nonconcave penalized likelihood with a diverging number of parameters. The Annals of Statistics 32, 928–961.

Francq, C., Thieu, 2019. Qml inference for volatility models with covariates. Econometric Theory 35, 37–72.

Francq, C., Zako¨ıan, J.M., 2018. Estimation risk for the var of portfolios driven by semi-parametric multivariate models. Journal of Econometrics 205, 381–401.

Francq, C., Zako¨ıan, J.M., 2009. Bartlett’s formula for a general class of nonlinear processes. Journal of Time Series Analysis 30, 449–465.

Francq, C., Zako¨ıan, J.M., 2019. GARCH Models: Structure, Statistical Inference and Financial Applications. John Wiley & Sons.

Frömmel, M., Han, X., Kratochvil, S., 2014. Modeling the daily electricity price volatility with realized measures. Energy Economics 44, 492–502.

Fu, W., Knight, K., 2000. Asymptotics for lasso-type estimators. The Annals of Statistics 28, 1356–1378.

Hannan, E.J., McDougall, A.J., 1988. Regression procedures for arma estimation. Journal of the American Statistical Association 83, 490–498.

Janczura, J., Weron, R., 2012. Efficient estimation of markov regime-switching models: An application to electricity spot prices. AStA Advances in Statistical Analysis 96, 385–407.

Kock, A.B., 2016. Consistent and conservative model selection with the adaptive lasso in stationary and nonstationary autoregressions. Econometric Theory 32, 243–259.

Ling, S., McAleer, M., 2010. A general asymptotic theory for time-series models. Statistica Neerlandica 64, 97–111.

Liu, H., Shi, J., 2013. Applying arma–garch approaches to forecasting short-term electricity prices. Energy Economics 37, 152–166.

Loh, P.L., 2017. Statistical consistency and asymptotic normality for high-dimensional robust m-estimators. Annals of Statistics 45, 866–896.

Nardi, Y., Rinaldo, A., 2011. Autoregressive process modeling via the lasso procedure. Journal of Multivariate Analysis 102, 528–549.

Nielsen, H.B., Rahbek, A., 2024. Penalized quasi-likelihood estimation and model selection with parameters on the boundary of the parameter space. The Econometrics Journal 27, 107–125.

Pan, J., Wang, H., Yao, Q., 2007. Weighted least absolute deviations estimation for arma models with infinite variance. Econometric Theory 23, 852–879.

Poignard, B., Fermanian, J.D., 2021. High-dimensional penalized arch processes. Econometric Reviews 40, 86–107.

Rockafellar, R.T., 1970. Convex Analysis. Princeton University Press.

Samitas, A., Armenatzoglou, A., 2014. Regression tree model versus markov regime switching: A comparison for electricity spot price modelling and forecasting. Operational Research 14, 319–340.

Schwarz, G., 1978. Estimating the dimension of a model. The Annals of Statistics 6, 461–464.

Tibshirani, R., 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 58, 267–288.

Van der Vaart, A.W., Wellner, J.A., 1996. Weak Convergence and Empirical Processes: With Applications to Statistics. Springer.

Wang, H., Li, G., Tsai, C.L., 2007. Regression coefficient and autoregressive order shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 69, 63–78.

Wang, Z., Liu, H., Zhang, T., 2014. Optimal computational and statistical rates of convergence for sparse nonconvex learning problems. Annals of Statistics 42, 2164–2201.

Zhang, C.H., Huang, J., 2008. The sparsity and bias of the lasso selection in high-dimensional linear regression. The Annals of Statistics 36, 1567–1594.

Zou, H., 2006. The adaptive lasso and its oracle properties. Journal of the American Statistical Association 101, 1418–1429.