Comparative study of static and dynamic neural network models for nonlinear time series forecasting

Abounoori, Abbas Ali and Mohammadali, Hanieh and Gandali Alikhani, Nadiya and Naderi, Esmaeil (2012): Comparative study of static and dynamic neural network models for nonlinear time series forecasting.

Abstract

During the recent decades, neural network models have been focused upon by researchers due to their more real performance and on this basis different types of these models have been used in forecasting. Now, there is this question that which kind of these models has more explanatory power in forecasting the future processes of the stock. In line with this, the present paper made a comparison between static and dynamic neural network models in forecasting the return of Tehran Stock Exchange (TSE) index in order to find the best model to be used for forecasting this series (as a nonlinear financial time series). The data were collected daily from 25/3/2009 to 22/10/2011. The models examined in this study included two static models (Adaptive Neuro-Fuzzy Inference Systems or ANFIS and Multi-layer Feed-forward Neural Network or MFNN) and a dynamic model (nonlinear neural network autoregressive model or NNAR). The findings showed that based on the Mean Square Error and Root Mean Square Error criteria, ANFIS model had a much higher forecasting ability compared to other models.

• Item Type: MPRA Paper
• Language: English
• Keywords: Forecasting, Stock Market, dynamic Neural Network, Static Neural Network.
• Subjects: C - Mathematical and Quantitative Methods > C2 - Single Equation Models ; Single Variables > C22 - Time-Series Models ; Dynamic Quantile Regressions ; Dynamic Treatment Effect Models ; Diffusion Processes; C - Mathematical and Quantitative Methods > C4 - Econometric and Statistical Methods: Special Topics > C45 - Neural Networks and Related Topics; C - Mathematical and Quantitative Methods > C6 - Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C60 - General; G - Financial Economics > G1 - General Financial Markets > G14 - Information and Market Efficiency ; Event Studies ; Insider Trading; G - Financial Economics > G1 - General Financial Markets > G17 - Financial Forecasting and Simulation

References

Abhyankar, A.H., Copeland, L.S., Wong, W. (1995). Uncovering Nonlinear Dynamics Structure in Real-Time Stock Market Indexes. Journal of Business and Economic Statistics 15(1), PP. 1-14.

Aladag, H.A., Egrioglu, E., Kadilar, C. (2009). Forecasting Nonlinear Time Series with a Hybrid Methodology. Applied Mathematic Letters, 22, PP. 1467-147.

Al-Khazali, O.M., Pyun, C.S., Kim, D. (2012). Are Exchange Rate Movements Predictable in Asia-Pacific Markets? Evidence of Random Walk and Martingale Difference Processes, International Review of Economics and Finance 21(1), PP. 221–231.

Bley, J. (2011). Are GCC Stock Markets Predictable?. Emerging Markets Review 12(3), PP. 217–237.

Briatka, L. (2006). How Big is Big Enough? Justifying Results of the i.i.d Test Based on the Correlation Integral in the Non-Normal World. Working Paper Series, Charles University, ISSN. 1211-3298, 308, PP. 1-34.

Brock, W.A., Dechert, W.D., Sheinkman, J.A. (1987). A Test of Independence Based on the Correlation Dimension. Working paper, University of Wisconsin at Madison, University of Houston, and University of Chicago, 8702, PP. 1-38.

Chiang, Y. M., Chang, L. Ch., Chang, F.J. (2004). Comparison of static-feedforward and dynamic-feedback neural networks for rainfall–runoff modeling. Journal of Hydrology, 290(3–4), PP. 297-311.

Colombage, S. (2009). Financial Markets and Economic Performances: Empirical Evidence from Five Industrialized Economies. Research in International Business and Finance 23(3), PP.339-348.

Cootner, H. (1964). The random character of stock market prices. M.I.T. Press, Massachusetts.

Cox, J.E., Loomis, D.G. (2006). Improving Forecasting through Textbooks-A 25 Year Review. International Journal of Forecasting 22(3), PP. 617-624.

Cybenko, G. (1989). Approximations by superpositions of sigmoidal functions. Mathematics of Control, Signals, and Systems 2(4), PP. 303-314.

Dase, R.K., Pawar, D.D. (2010). Application of Artificial Neural Network for stock Market Predictions: A review of literature. International Journal of Machine Intelligence 2(2), pp.14-17.

Deng, J. (2013). Dynamic Neural Networks with Hybrid Structures for Nonlinear System Identification. Engineering Applications of Artificial Intelligence 26 (1), PP. 281–292.

Dorum, A., Yarar, A. Sevimli, M. F. Onüçyildiz, M. (2010). Modelling the rainfall-runoff data of susurluk basin, Expert Systems with Applications 37(9), PP. 6587-6593.

Funahashi, K. I. (1989). On the Approximate Realization of Continuous Mappings by Neural Networks. Neural Networks 2(3), PP. 183–192.

Gallant A.R. White, H. (1992). On Learning the Derivatives of an Unknown Mapping with Multilayer Feedforward Networks. Neural Networks 5, PP. 129-138.

Georgescu, V. Dinucă, E. C. (2011). Evidence of Improvement in Neural-Network Based Predictability of Stock Market Indexes through Co-movement Entries. Recent Advances in Applied & Biomedical Informatics and Computational Engineering in Systems Applications, 11th WSEAS International Conference on Applied Informatics and Communications, Florence, Italy, PP.412-417.

Ghiassi, M., Zimbra, D. K. Saidane, H. (2006). Medium term system load forecasting with a dynamic artificial neural network model. Electric Power Systems Research 76(5), PP. 302-316.

Giovanis, E. (2010). Application of Feed-Forward Neural Networks Autoregressive model with Genetic Algorithm in Gross Domestic Product Prediction, World Academy of Science, Engineering and Technology 64. pp. 638-664.

Granger, C.W.J., Timmermann, A. (2004). Efficient market hypothesis and forecasting. International Journal of Forecasting 20(1), PP. 15–27.

Guresen, E., Kayakutlu, G., Daim, U. T. (2011). Using Artificial Neural Network Models in Stock Market Index Prediction. Expert Systems with Applications 38(8), PP. 10389-10397.

Hornik, K., Stinchcombe, M., White, H. (1990). Universal Approximation of an Unknown Mapping and its Derivatives Using Multilayer Feedforward Networks, Neural Networks 3(5), PP. 551-560.

Hou, k., Moskowitz, T.J. (2005). Market Frictions, Price Delay and the Cross-Section of Expected Returns, Review of Financial Studies 18(3), pp. 981- 1020.

Mantri, J. K., Gahan, P., Nayak, B.B. (2010). Artificial neural networks- An application to stock market volatility. International Journal of Engineering Science and Technology 2(5), pp 1451-1460.

Kamali, R., Binesh, A. R. (2013). A comparison of neural networks and adaptive neuro-fuzzy inference systems for the prediction of water diffusion through carbon nanotubes. Microfluidics and Nanofluidics 14(3-4), PP. 575-581.

Krose, B., Smagt, P. (1996). An introduction to neural network. The University of Amsterdam. Eighth edition.

Lee, T.H., White, H., Granger, C.W.J. (1992). Testing for Neglected Nonlinearity in Time-Series Models: A Comparison of Neural Network Methods and Standard Tests. Journal of Econometrics 56(3), PP. 269-290.

Levenberg, K. (1944). A Method for the Solution of Certain Nonlinear Problems in Least Squares. Quart Applied Mathematics 2, pp. 164-168.

Li F., Liu, C. (2009). Application Study of BP Neural Network on Stock Market Prediction. Ninth International Conference on Hybrid Intelligent Systems 3, pp: 174-178, IEEE.

Lo, A. W., MacKinlay, C. (1988). The Size and Power of the Variance Ratio Tests in Finite Samples: A Monte Carlo Investigation. Journal of Econometrics 40, pp. 203-238.

Lotfi, A. Z. (1965). Fuzzy sets. Information and Control 8(3), PP. 338–353.

Lotfi, A. Z. (1965). Fuzzy sets and systems. In: Fox J, editor. System Theory. Brooklyn, NY: Polytechnic Press, PP. 29–39.

Marquardt, D. W. (1963). An Algorithm for Least Squares Estimation of Nonlinear Parameters. Journal Society Industrial Applied Mathematics 11(2), pp. 431-441.

Matkovskyy, R. (2012). Forecasting the Index of Financial Safety (IFS) of South Africa using neural networks, MPRA Paper 42153, University Library of Munich, Germany.

McClelland, J.L., Rumelhart, D.E., Hinton, G.E. (1986). The appeal of parallel distributed processing. In Parallel Distributed Processing: Foundations 1, pp.3-44.

Mehrara, M., Moeini, A., Ahrari, M. Ghafari, A. (2010). Using Technical Analysis with Neural Network for Prediction Stock Price Index in Tehran Stock Exchange. Middle Eastern Finance and Economics 6(6), PP. 50-61.

Melin, P., Soto, J., Castillo, O., Soria, J. (2012). A new approach for time series prediction using ensembles of ANFIS models. Expert Systems with Applications 39(3), PP. 3494-3506.

Moloney, K., Raghavendra, S. (2011). Testing for Nonlinear Dependence in the Credit Default Swap Market, Economics Research International, Article ID 708704, PP. 1-11.

Mukerji, A., Chatterjee, C., Raghuwanshi, N.S. (2009). Flood Forecasting Using ANN, Neuro-Fuzzy, and Neuro-GA Models. Journal of Hydrologic Engineering, 14(6), PP. 647-652.

Nielsen, H. (1987). Kolomogorr’s Mapping Neural Network Existence Theorem, In IEEE First Annual International Conference on Neural Networks 3, PP. 11-14.

Olmedo, E. (2011). Is there chaos in the Spanish labour market?.Chaos, Solitons & Fractals 44(12), PP.1045-1053.

Charkha, P. R. (2008). Stock Price Prediction and Trend Prediction using Neural Networks. First International Conference on Emerging Trends in Engineering and Technology, pp: 592-594, IEEE.

Ripley, B.D. (1996). Pattern Recognition and Neural Networks, Cambridge University Press.

Rosenblatt, F. (1961). Principles of Neurodynamics: perceptrons and the theory of brain mechanisms. Spartan Press, Washington.

Sahin, S., Tolu, M.R., Hassanpour, R. (2012). Hybrid expert systems: A survey of current approaches and applications. Expert Systems with Applications 39(4), PP. 4609-4617.

Scheinkman, J., Lebaron, B. (1989). Nonlinear dynamics and stock returns. Journal of business 62(3), PP. 311-337.

Sheta, A. F., Jong, K. D. (2001). Time-series forecasting using GA-tuned radial basis functions. Information Sciences 133(3–4), PP. 221–228.

Soni, S. (2011). Applications of ANNs in Stock Market Prediction: A Survey. International Journal of Computer Science & Engineering Technology 2(3), pp. 71-83.

Stinchcombe M., White, H. (1992). Using Feedforward Networks to Distinguish Multivariate Populations. Proceedings of the International Joint Conference on Neural Networks 1, pp.788-793.

Taskaya-Temizel, T., Casey, M.C. (2005). A Comparative Study of Autoregressive Neural Network Hybrids. Neural Networks 18(5-6), PP. 781-789.

Thenmozhi, M. (2006). Forecasting Stock Index Returns Using Neural Networks. Delhi Business Review 7(2), pp. 59-69.

Tong-Seng Q. (2007). Using Neural Network for DJIA Stock Selection. Engineering Letters 15(1). pp 15-31.

Trapletti A., Leisch, F., Hornik, K. (2000). Stationary and integrated autoregressive neural network processes. Neural Computation 12(10), pp. 2427-2450.

Tsipouras, M., Exarchos, T.P., Fotiadis, D. (2008). Automated Fuzzy Model Generation Through Weigh and Fuzzification Parameters' Optimization. International Conference on Fuzzy Systems, PP. 2186-2193.

Tsoi, A. Ch., Back, A. (1995). Static and dynamic preprocessing methods in neural networks. Engineering Applications of Artificial Intelligence 8(6), PP. 633–642.

Wanous, M., Boussabaine, A.H. Lewis, J. (2000). Bidno bid: a parametric solution. Construction Management and Economics, 18(4), PP. 457-466.

White, H. (1992). Nonparametric Estimation of Conditional Quantiles Using Neural Networks. In Proceedings of the Symposium on the Interface. New York: Springer-Verlag, PP. 190-199.

Zhou, W., Sornette, D. (2006). Fundamental Factors versus Herding in the 2000–2005 US Stock Market and Prediction. Physica A: Statistical Mechanics and its Applications 360(2), PP. 459-482.