A statistical evaluation of GAP's forecasting performance for the Albanian economy

Papavangjeli, Meri and Rama, Arlind (2018): A statistical evaluation of GAP's forecasting performance for the Albanian economy. Published in: Bank of Albania Working Paper Series (2018): pp. 1-28.

Abstract

This paper aims at offering a statistical evaluation methodology on the forecasting performance of the GAP model, a semi-structural economic model used to support monetary policy decisions at the Bank of Albania since 2011. In this paper we evaluate the forecasts produced purely by the model, and not those used by the Monetary Policy Department, which also include the expert judgment and are not made public. The analytical approach used in the discussion material combines a statistical diagnostic look-up consisting in statistical measurements as RMSE and BIAS important to understand the forecasting performance of the model as an instrument in one, two and three years ahead time horizons. A VAR model is constructed resembling the economic relations represented in the GAP model as a most commonly used tool to obtain economic projections based solely on the information that the data series provide. Comparing the forecasting performance of the two models on a common statistical diagnostic metrics helps us to create a broader understanding of the forecasting abilities of the GAP model and draw discussion issues for potential improvements of the model that would potentially lead to an improved representation of the Albanian economy and increased accuracy in its forecasting performance.

• Item Type: MPRA Paper
• Language: English
• Keywords: forecasting performance, GAP model, statistical metrics
• Subjects: C - Mathematical and Quantitative Methods > C5 - Econometric Modeling; E - Macroeconomics and Monetary Economics > E3 - Prices, Business Fluctuations, and Cycles > E37 - Forecasting and Simulation: Models and Applications

References

Adolfson, M., M. K. Andersson, J. Lindé, M. Villani & A. Vredin, (2007), “Modern forecasting models in action: Improving analyses at central banks”, International Journal of central banking, forthcoming Andersson, M K, Karlsson, G and svensson, J (2007), ‘the riksbank’s forecasting performance’, Working Paper series 218, sveriges riksbank. Andrews, D W K (1991), ‘heteroskedasticity and autocorrelation consistent covariance matrix estimation’, Econometrica, Vol. 59, No. 3, pages 817–58. Diebold, f X and Mariano, r s (1995), ‘comparing predictive accuracy’, Journal of business & Economic statistics, Vol. 13, No. 3, pages 253–63. Domit, s., franceska Monti and Andrej sokol (2016), ‘A bayesian VAr benchmark for cOMPAss’, staff Working Paper No. 583. Dushku, E. and Kota, V. (2011), ‘A bayesian Estimation of A small structural Model for the Albanian Economy’, boA Working Paper. hackworth, c, radia, A and roberts, N (2013), ‘Understanding the MPc’s forecast performance since mid-2010’, bank of England Quarterly bulletin, Vol. 53, No. 4, pages 336–50, available at www.bankofengland.co.uk/publications/Documents/ quarterlybulletin/2013/qb130405.pdf hong and tan (2014), “A comparative study of the forecasting performance of three international organizations”, DEsA Working Paper No. 133 st/EsA/2014/DWP/133. Iversen, J., s. Laseen, h. Lundvall and U. soderstrom (2014), “realtime forecasting for Monetary Policy Analysis: the case of sveriges riksbank,” mimeo. fawcett, N, Körber, L, Masolo, r M and Waldron, M (2015), ‘Evaluating UK point and density forecasts from an estimated DsGE model: the role of off-model information over the financial crisis’, Bank of England Working Paper No. 538, available at www.bankofengland. co.uk/research/Documents/workingpapers/2015/swp538.pdf. Groen, J J J, Kapetanios, G and Price, s (2009), ‘A real time evaluation of bank of England forecasts of inflation and growth’, International Journal of forecasting, Vol. 25, No. 1, pages 74–80. sims, c. A. and t. Zha (1998), “bayesian Methods for Dynamic Multivariate Models,” International Economic review, vol. 39(4), pages 949-68. timmermann, A (2006), ‘An evaluation of the World Economic Outlook forecasts’, International Monetary fund Working Paper WP/06/59.