Assessing the Performance of a Prediction Error Criterion Model Selection Algorithm in the Context of ARCH Models

Degiannakis, Stavros and Xekalaki, Evdokia (2007): Assessing the Performance of a Prediction Error Criterion Model Selection Algorithm in the Context of ARCH Models. Published in: Applied Financial Economics No. 17 (2007): pp. 149-171.

Abstract

Autoregressive conditional heteroscedasticity (ARCH) models have successfully been applied in order to predict asset return volatility. Predicting volatility is of great importance in pricing financial derivatives, selecting portfolios, measuring and managing investment risk more accurately. In this paper, a number of ARCH models are considered in the framework of evaluating the performance of a method for model selection based on a standardized prediction error criterion (SPEC). According to this method, the ARCH model with the lowest sum of squared standardized forecasting errors is selected for predicting future volatility. A number of statistical criteria, that measure the distance between predicted and inter-day realized volatility, are used to examine the performance of a model to predict future volatility, for forecasting horizons ranging from one day to one hundred days ahead. The results reveal that the SPEC model selection procedure has a satisfactory performance in picking that model that generates “better” volatility predictions. A comparison of the SPEC algorithm with a set of other model evaluation criteria yields similar findings. It appears, therefore, that it can be regarded as a tool in guiding one’s choice of the appropriate model for predicting future volatility, with applications in evaluating portfolios, managing financial risk and creating speculative strategies with options.

• Item Type: MPRA Paper
• Language: English
• Keywords: ARCH Models, Correlated Gamma Ratio Distribution, Model Selection, Predictability, SPEC Algorithm, Volatility Forecasting
• Subjects: C - Mathematical and Quantitative Methods > C3 - Multiple or Simultaneous Equation Models ; Multiple Variables > C32 - Time-Series Models ; Dynamic Quantile Regressions ; Dynamic Treatment Effect Models ; Diffusion Processes ; State Space Models; C - Mathematical and Quantitative Methods > C4 - Econometric and Statistical Methods: Special Topics > C40 - General; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C52 - Model Evaluation, Validation, and Selection; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C53 - Forecasting and Prediction Methods ; Simulation Methods

References

Adrangi, B. and Chatrath, A. (2003). Non-Linear Dynamics in Futures Prices: Evidence From the Coffee, Sugar and Cocoa Exchange. Applied Financial Economics, 13, 245-256.

Akaike, H. (1973). Information Theory and an Extension of the Maximum Likelihood Principle. Proceedings of the second international symposium on information theory. B.N. Petrov and F. Csaki (eds.), Budapest, 267-281.

Alizabeh, S., Brandt M.W. and Diebold, F.X. (2002). Range-Based Estimation of Stochastic Volatility Models. Journal of Finance, LV11, 1047-1091.

Andersen, T. and Bollerslev, T. (1997). Intraday Periodicity and Volatility Persistence in Financial Markets. Journal of Empirical Finance, 4, 115-158.

Andersen, T. and Bollerslev, T. (1998a). Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts. International Economic Review, 39, 885-905.

Andersen, T. and Bollerslev, T. (1998b). DM-Dollar Volatility: Intraday Activity Patterns, Macroeconomic Announcements and Longer-Run Dependencies. Journal of Finance, 53, 219-265.

Andersen, T., Bollerslev, T. and Lange, S. (1999). Forecasting Financial Market Volatility: Sample Frequency vis-à-vis Forecast Horizon. Journal of Empirical Finance, 6, 457-477.

Andersen, T., Bollerslev T. and Cai, J. (2000a). Intraday and Interday Volatility in the Japanese Stock Market. Journal of International Financial Markets, Institutions and Money, 10, 107-130.

Andersen, T., Bollerslev, T., Diebold, F.X. and Labys, P. (2000b). Exchange Rate Returns Standardized by Realized Volatility are (Nearly) Gaussian. Multinational Finance Journal, 4, 159-179.

Andersen, T., Bollerslev, T., Diebold, F.X. and Labys, P. (2001a). The Distribution of Exchange Rate Volatility. Journal of the American Statistical Association, 96, 42-55.

Andersen, T., Bollerslev, T., Diebold, F.X. and Ebens, H. (2001b). The Distribution of Stock Return Volatility. Journal of Financial Economics, 61, 43-76.

Andersen, T., Bollerslev, T., Diebold, F.X. and Labys, P. (2003). Modeling and Forecasting Realized Volatility. Econometrica, 71, 529-626.

Andersen, T., Bollerslev, T. and Diebold, F.X. (2005). Parametric and Nonparametric Volatility Measurement. Handbook of Financial Econometrics, (eds.) Yacine Aït-Sahalia and Lars Peter Hansen, Amsterdam, North Holland.

Angelidis, T., Benos, A. and Degiannakis, S. (2004). The Use of GARCH Models in VaR Estimation. Statistical Methodology, 1, 1(2), 105-128.

Barkoulas, J. and Travlos, N. (1998). Chaos in an Emerging Capital Market? The Case of the Athens Stock Exchange. Applied Financial Economics, 8, 231-243.

Barkoulas, J., Baum, C.F. and Travlos, N. (2000). Long Menory in the Greek Stock Market. Applied Financial Economics, 10, 177-184.

Barndorff-Nielsen, O.E. and Shephard, N. (1998). Aggregation and Model Construction for Volatility Models. University of Aarhus and Nuffield College, Oxford, Department of Mathematical Sciences, Manuscript.

Basle Committee on Banking Supervision. (1998). International Convergence of Capital Measurement and Capital Standards.

Bera, A.K. and Higgins, M.L. (1993). ARCH Models: Properties, Estimation and Testing. Journal of Economic Surveys, 7, 305-366.

Berndt, E.R., Hall, B.H. Hall, R.E. and Hausman, J.A. (1974). Estimation and Inference in Nonlinear Structural Models. Annals of Economic and Social Measurement, 3, 653-665.

Bollerslev, T. (1986). Generalized Autoregressive Conditional Heteroskedasticity. Journal of Econometrics, 31, 307–327.

Bollerslev, T. and Wooldridge, J.M. (1992). Quasi-maximum Likelihood Estimation and Inference in Dynamic Models with Time-Varying Covariances. Econometric Reviews, 11, 143-172.

Bollerslev, T., Chou, R. and Kroner, K.F. (1992). ARCH Modeling in Finance: A Review of the Theory and Empirical Evidence. Journal of Econometrics, 52, 5-59.

Bollerslev, T., Engle, R.F. and Nelson, D. (1994). ARCH Models, in Handbook of Econometrics, Volume 4, eds. R. Engle and D. McFadden, Elsevier Science, Amsterdam, 2959-3038.

Brock, W. (1986). Distinguishing Random and Deterministic Systems: Abridged Version, Journal of Economic Theory, 40, 168-195.

Brock, W.A., Dechert, W.D. and Scheinkman, J.A. (1987). A Test for Independence Based on the Correlation Dimension. Department of Economics, University of Wisconsin, Madison, WI. SSRI, Working Paper no. 8702.

Brooks, C. and Persand, G. (2003). The effect of asymmetries on stock index return Value-at-Risk estimates. The Journal of Risk Finance, Winter, 29-42.

Campbell, J., Lo, A. and MacKinlay, A.C. (1997). The Econometrics of Financial Markets. New Jersey. Princeton University Press.

Christoffersen, P. and Jacobs, K. (2003). Which Volatility Model for Option Evaluation?, Faculty of Management, McGill University, Manuscript.

Cohen, K., Hawawini, G., Maier, S., Schwartz, R. and Whitcomb, D. (1983). Friction in the Trading Process and the Estimation of Systematic Risk. Journal of Financial Economics, 12, 263-278.

Degiannakis, S. (2004). Volatility Forecasting: Evidence from a Fractional Integrated Asymmetric Power ARCH Skewed-t Model. Applied Financial Economics, 14, 1333-1342.

Degiannakis, S. and Xekalaki, E. (2001). Using a Prediction Error Criterion for Model Selection in Forecasting Option Prices. Technical Report no 131, Department of Statistics, Athens University of Economics and Business.

Degiannakis, S. and Xekalaki, E. (2004). Autoregressive Conditional Heteroscedasticity Models: A Review. Quality Technology and Quantitative Management, 1, (2), 271-324.

Degiannakis, S. and Xekalaki, E. (2005). Predictability and Model Selection in the Context of ARCH Models. Journal of Applied Stochastic Models in Business and Industry, 21, 55-82.

Diebold, F.X. and Mariano, R. (1995). Comparing Predictive Accuracy, Journal of Business and Economic Statistics, 13, 3, 253-263.

Dimson, E. (1979). Risk Measurement When Shares Are Subject to Infrequent Trading. Journal of Financial Economics, 7, 197-226.

Ebens, H. (1999). Realized Stock Volatility. Department of Economics, Johns Hopkins University, Working Paper, 420.

Engle, R.F., Hong, C.H., Kane, A. and Noh, J. (1993). Arbitrage Valuation of Variance Forecasts with Simulated Options, Advances in Futures and Options Research, 6, 393-415.

Ferreira, M.A. and Lopez, J.A. (2003). Evaluating Interest Rate Covariance Models within a Value-at-Risk Framework. Economic Research Department, Federal Reserve Bank of San Francisco, manuscript.

Franses, P.H. and Homelen, P.V. (1998). On Forecasting Exchange Rates Using Neural Networks. Applied Financial Economics, 8, 589-596.

Frey, R. and Michaud, P. (1997). The Effect of GARCH-type Volatilities on Prices and Payoff-Distributions of Derivative Assets - a Simulation Study, ETH Zurich, Working Paper.

Giot, P. and Laurent, S. (2003). Value-at-Risk for Long and Short Trading Positions. Journal of Applied Econometrics, 18, 641-664.

Giot, P. and Laurent, S. (2004). Modelling Daily Value-at-Risk Using Realized Volatility and ARCH Type Models. Journal of Empirical Finance, 11, 379-398.

Glosten, L., Jagannathan, R. and Runkle, D. (1993). On the Relation Between the Expected Value and the Volatility of the Nominal Excess Return on Stocks. Journal of Finance, 48, 1779–1801.

González-Rivera, G., Lee, T-H and Mishra, S. (2004). Forecasting Volatility: A Reality Check Based on Option Pricing, Utility Function, Value-at-Risk and Predictive Likelihood. International Journal of Forecasting, 20, 629-645.

Gourieroux, C. (1997). ARCH models and Financial Applications. Springer-Verlag, New York.

Hamilton, J. (1994). Time Series Analysis, New Jersey: Princeton University Press

Hansen, P.R. and Lunde, A. (2003). A Forecast Comparison of Volatility Models: Does Anything Beat a GARCH(1,1)? Brown University, Department of Economics, Working Paper.

Hansen, P.R., Lunde, A. and Nason, J.M. (2003). Choosing the Best Volatility Models: The Model Confidence Set Approach. Brown University, Department of Economics, Working Paper.

Hecq, A. (1996). IGARCH Effect on Autoregressive Lag Length Selection and Causality Tests. Applied Economics Letters, 3, 317-323.

Hertz, J., Krogh, A. and Palmer, R. (1991). Introduction to the Theory of Neural Computation, Addison-Wesley Publishing Company, Reading, MA.

Heynen, R. and Kat, H. (1994). Volatility Prediction: A Comparison of the Stochastic Volatility, Garch(1,1) and Egarch(1,1) Models. Journal of Derivatives, 94, 50-65.

Hol, E. and Koopman, S. (2000). Forecasting the Variability of Stock Index Returns with Stochastic Volatility Models and Implied Volatility. Tinbergen Institute, Discussion Paper No. 104,4.

Holden, A. (1986). Chaos, New Jersey: Princeton University Press.

Hsieh, D. (1991). Chaos and Nonlinear Dynamics: Application to Financial Markets, Journal of Finance, 46, 1839-1877.

Hutchinson, J., Lo, A. and Poggio, T. (1994). A Nonparametric Approach to the Pricing and Hedging of Derivative Securities Via Learning Networks, Journal of Finance, 49, 851-889.

Jasic, T. and Wood, D. (2004). The Profitablity of Daily Stock Market Indices Trades Based on Neural Network Predictions: Case Study for the S&P500, the DAX, the TOPIX and the FTSE in the Period 1965-1999. Applied Financial Economics, 14, 285-297.

Kibble, W. F. (1941). A Two Variate Gamma Type Distribution. Sankhya, 5, 137-150.

Klaassen, F. (2002). Improving GARCH Volatility Forecasts With Regime-Switching GARCH, in Advances in Markov-Switching Models, eds. J.D. Hamilton and B. Raj, Psysica Verlag, New York, 223-254.

Lo, A. and MacKinlay, A.C. (1988). Stock Market Prices Do Not Follow Random Walks: Evidence from a Simple Specification Test. Review of Financial Studies, 1, 41-66.

Lo, A. and MacKinlay, A.C. (1990). An Econometric Analysis of Non-synchronous Trading. Journal of Econometrics, 45, 181-212.

Lopez, J.A. and Walter, C.A. (2001). Evaluating Covariance Matrix Forecasts in a Value-at-Risk Framework. Journal of Risk, 3, 3, 69-98.

Marquardt, D.W. (1963). An Algorithm for Least Squares Estimation of Nonlinear Parameters. Journal of the Society for Industrial and Applied Mathematics, 11, 431-441.

Nelson, D. (1991). Conditional Heteroskedasticity in Asset Returns: A New Approach. Econometrica, 59, 347-370.

Pagan, A.R. and Schwert, G.W. (1990). Alternative Models for Conditional Stock Volatility. Journal of Econometrics, 45, 267-290.

Peel, D.A. and Speight, A.E.H. (1996). Is the US Business Cycle Asymmetric? Some Further Evidence. Applied Economics, 28, 405-415.

Perez-Rodriguez, J.V., Torra, S. and Andrada-Felix, J. (2005). Are Spanish Ibex35 Stock Future Index Returns Forecasted with Non-Linear Models? Applied Financial Economics, 15, 963-975.

Plasmans, J., Verkooijen, W. and Daniels, H. (1998). Estimating Structural Exchange Rate Models by Artificial Neural Networks. Applied Financial Economics, 8, 541-551.

Poggio, T. and Girosi, F. (1990). Networks for Approximation and Learning, Proceeding of the IEEE, special issue: Neural Networks I: Theory and Modeling, 78, 1481-1497.

Priestley, M. (1988). Nonlinear and Non-Stationary Time Series Analysis, Academic Press, San Diego.

Sadorsky, P. (2005). Stochastic Volatility Forecasting and Risk Management. Applied Financial Economics, 15, 121-135.

Saez, M. (1997). Option Pricing Under Stochastic Volatiltiy and Stochastic Interest Rate in the Spanish Case. Applied Financial Economics, 7, 379-394.

Saltoglu, B. (2003). Comparing Forecasting Ability of Parametric and Non-Parametric Methods: An Application with Canadian Monthly Interest Rates. Applied Financial Economics, 13, 169-179.

Scholes, M. and Williams, J. (1977). Estimating Betas from Non-Synchronous Data. Journal of Financial Economics, 5, 309-328.

Schwarz, G. (1978). Estimating the Dimension of a Model. Annals of Statistics, 6, 461-464.

Selcuk, F. (2005). Asymmetric Stochastic Volatility in Emerging Stock Market. Applied Financial Economics, 15, 867-874.

Shephard, N. (1996). Statistical Aspects of ARCH and Stochastic Volatility Models. In Time Series Models in Econometrics, Finance and Other Fields, 1-67, (eds.) D.R. Cox, D.V. Hinkley and O.E. Barndorff-Nielsen, Chapman & Hall, London.

Taylor, S.J. (1994). Modelling Stochastic Volatility: A Review and Comparative Study. Mathematical Finance, 4, 183-204.

Teräsvirta, T., Tjǿstheim, D. and Granger, C. (1994). Aspects of Modeling Nonlinear Time Series, in Handbook of Econometrics, Volume 4, eds. R. Engle and D. McFadden, Elsevier Science, Amsterdam.

Thompson, J. and Stewart, H. (1986). Nonlinear Dynamics and Chaos, John Wiley and Sons, NY.

Tong, H. (1990). Nonlinear Time Series: A Dynamic System Approach, Oxford University Press, Oxford.

Vilasuso, J. (2002). Forecasting Exchange Rate Volatility. Economics Letters, 76, 59-64.

Walsh, D.M. and Tsou, G. Y.-G. (1998). Forecasting Index Volatility: Sampling Interval and Non-Trading Effects. Applied Financial Economics, 8, 477-485.

West, K.D. and Cho, D. (1995). The Predictive Ability of Several Models of Exchange Rate Volatility, Journal of Econometrics, 69, 367-391.

West, K.D., Edison, H.J. and Cho, D. (1993). A Utility Based Comparison of Some Models for Exchange Rate Volatility. Journal of International Economics, 35, 23-45.

White, H. (1992). Artificial Neural Networks: Approximation and Learning Theory, Blackwell Publishers, Cambridge, MA.

Xekalaki, E. and Degiannakis, S. (2005). Evaluating Volatility Forecasts in Option Pricing in the Context of a Simulated Options Market. Computational Statistics and Data Analysis. Special Issue on Computational Econometrics, 49(2), 611-629.

Xekalaki E., Panaretos, J. and Psarakis, S. (2003). A Predictive Model Evaluation and Selection Approach - The Correlated Gamma Ratio Distribution. Stochastic Musings: Perspectives from the Pioneers of the Late 20th Century, (J. Panaretos, ed.), Lawrence Erlbaum, Associates Publishers, 188-202.

Yu, J. (2002). Forecasting Volatility in the New Zealand Stock Market. Applied Financial Economics, 12, 193-202.