Forecast variance in simultaneous equation models: analytic and Monte Carlo methods

Bianchi, Carlo and Brillet, Jean-Louis and Calzolari, Giorgio and Panattoni, Lorenzo (1987): Forecast variance in simultaneous equation models: analytic and Monte Carlo methods. Published in: INSEE, Paris, France No. Paper presented at the Seminaire d'Econometrie de Malinvaud (February 1987): pp. 1-19.

Abstract

Five alternative techniques have been applied to measure the degree of uncertainty associated with the forecasts produced by a macro-model of the French economy, the Mini-DMS developed at INSEE. They are bootstrap, analytic simulation on coefficients, Monte Carlo on coefficients, parametric stochastic simulation and re-estimation, a residual-based procedure. Due to the complexity and the size of the model (nonlinear and with more than 200 equations), several associated technical problems had to be solved. The remarkable convergence of results which has been obtained for all the main endogenous variables suggests that forecast confidence intervals are likely to be quite reliable for this model.

• Item Type: MPRA Paper
• Language: English
• Keywords: Bootstrap; analytic simulation; Monte Carlo; stochastic simulation; macroeconometric model; French economy
• Subjects: C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C53 - Forecasting and Prediction Methods ; Simulation Methods; C - Mathematical and Quantitative Methods > C6 - Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C63 - Computational Techniques ; Simulation Modeling

References

Amemiya, T. (1983): "Non-linear Regression Models", in Handbook of Econometrics, ed. by Z. Griliches and M. D. Intriligator. Amsterdam: North-Holland Publishing Company, Vol. I, 333-389.

Bianchi, C., J. L. Brillet et G. Calzolari (1984): Analyse et mesure de l'incertitude en prevision d'un modele eonometrique. Application au modele Mini-DMS, Annales de l'INSEE 54, 31-62.

Bianchi, C., J. L. Brillet. and G. Calzolari (1987, forthcoming): "Measuring Forecast Uncertainty: A Review with Evaluation Based on a Macro Model of the French Economy", International Journal of Forecasting 2.

Bianchi, C., and G. Calzolari (1980): "The One-Period Forecast Errors in Nonlinear Econometric Models", International Economic Review 21, 201-208.

Bianchi, C., and G. Calzolari (1982): "Evaluating Forecast Uncertainty Due to Errors in Estimated Coefficients: Empirical Comparison of Alternative Methods", in Evaluating the Reliability of Macro-Economic Models, ed. by G. C. Chow and P. Corsi. New York: John Wiley & Sons, Inc., 251-277.

Bianchi, C., and G. Calzolari (1983): "Standard Errors of Forecasts in Dynamic Simulation of Nonlinear Econometric Models: Some Empirical Results", in Time Series Analysis: Theory and Practice 3, ed. by O. D. Anderson. Amsterdam: North-Holland Publishing Company, 177-198.

Bianchi, C., G. Calzolari, and P. Corsi (1980): "A Package for Analytic Simulation of Econometric Models", in Optimization Techniques, Proceedings of the 9th IFIP Conference on Optimization Techniques. Warsaw, September 4-8, 1979, ed. by K.Iracki, K.Malanowski, and S.Walukiewicz. Berlin: Springer Verlag, Part 2, 404-413.

Brillet, J. L. (1981): "Mini-DMS: Modele Macroeconomique de Simulation". Paris: INSEE, Archives & Documents No. 35.

Brillet, J. L., G. Calzolari, and L. Panattoni (1986): "Coherent Optimal Prediction with Large Nonlinear Systems: An Example Based on a French Model". Paris: INSEE, Service des Programmes, discussion paper presented at the European Meeting of the Econometric Society. Budapest, September 1-5.

Brown, B. W., and R. S. Mariano (1984): "Residual-Based Procedures for Prediction and Estimation in a Nonlinear Simultaneous System", Econometrica 52, 321-343.

Brundy, J. M., and D. W. Jorgenson (1971): "Efficient Estimation of Simultaneous Equations by Instrumental Variables", The Review of Economics and Statistics 53, 207-224.

Calzolari, G. (1979): "Antithetic Variates to Estimate the Simulation Bias in Non-Linear Models", Economics Letters 4, 323-328.

Calzolari, G. (1981): "A Note on the Variance of Ex-Post Forecasts in Econometric Models", Econometrica 49, 1593-1595.

Calzolari, G. (1987): "Forecast Variance in Dynamic Simulation of Simultaneous Equation Models". Pisa: Centro Scientifico IBM (in corso di stampa su Econometrica 55/56).

Calzolari, G., and P. Corsi (1977): "Stochastic Simulation as a Validation Tool for Econometric Models", in Models for Regional Planning and Policy-Making, ed. by A. Straszak, and B. V. Wagle. Peterlee: IBM UKSC 0097, 359-369.

Calzolari, G., and F. P. Sterbenz (1986): "Control Variates to Estimate the Reduced Form Variances in Econometric Models", Econometrica 54, 1483-1490.

Cooper, J. P., and S. Fischer (1974): "Monetary and Fiscal Policy in the Fully Stochastic St. Louis Econometric Model", Journal of Money, Credit, and Banking 6, 1-22.

Corker, R., R. Ellis and S. Holly (1983): "Uncertainty and Forecasting Precision". London Business School, Centre for Economic Forecasting, Discussion Paper No.98.

Efron, B., 1979, Bootstrap methods: Another look to jackknife, Annals of Statistics 7, 1-16.

Fair, R. C. (1980): "Estimating the Expected Predictive Accuracy of Econometric Models", International Economic Review 21, 355-378.

Fisher, P., and M. Salmon (1986): "On Evaluating the Importance of Nonlinearity in Large Macroeconometric Models", International Economic Review 27, 625-646.

Fouquet. D. . J. M. Charpin. H. Guillaume, P. A. Muet et D. Vallet (1978): DMS, Modele Dynamique Multisectoriel, (Collections de l'INSEE, Paris) Serie C, No.64-65.

Freedman, A. D., and S. C. Peters (1984): "Bootstrapping an Econometric Model: Some Empirical Results", Journal of Business and Economics Statistics 2, 150-158.

Gallant, A. R. (1977): "Three-Stage Least-Squares Estimation for a System of Simultaneous, Nonlinear, Implicit Equations", Journal of Econometrics 5, 71-88.

Goldberger, A. S., A. L. Nagar and H. S. Odeh (1961): "The Covariance Matrices of Reduced-Form Coefficients and of Forecasts for a Structural Econometric Model", Econometrica 29, 556-573.

Haitovsky, Y., and N. Wallace (1972): "A Study of Discretionary and Nondiscretionary Monetary and Fiscal Policies in the Context of Stochastic Macroeconometric Models", in The Business Cycle Today, Fiftieth Anniversary Colloquium I, ed. by V. Zarnowitz. New York: National Bureau of Economic Research, Columbia University Press, 261-309.

Hall, S. G. (1986): "The Importance of Non-Linearities in Large Forecasting Models with Stochastic Error Processes", Journal of Forecasting 5, 205-215.

Hatanaka, M. (1978): "On the Efficient Estimation Methods for the Macro-Economic Models Nonlinear in Variables", Journal of Econometrics 8, 323-356.

Hendry, D. F. (1984): "Monte Carlo Experimentation in Econometrics", in Handbook of Econometrics, ed. by Z. Griliches and M. D. Intriligator. Amsterdam: North-Holland Publishing Company, Vol. II, 937-976.

Klein, L. R. (1969): "Estimation of lnterdependent Systems in Macroeconometrics", Econometrica 37, 171-192.

Mariano, R. S. (1982): "Analytical small sample distribution theory in econometrics: The simultaneous equations case", International Economic Review 23, 503-533.

McCarthy, M. D. (1972, a): "Some Notes on the Generation of Pseudo-Structural Errors for Use in Stochastic Simulation Studies", in Econometric Models of Cyclical Behavior, ed. by B. G. Hickman. New York: National Bureau of Economic Research, Studies in Income and Wealth No. 36, Columbia University Press, 185-191.

McCarthy, M. D. (1972, b): "A note on the forecasting properties of two-stage least squares restricted reduced forms: The finite sample case", International Economic Review 13, 757-761.

Nagar, A. L. (1969): "Stochastic Simulation of the Brookings Econometric Model", in The Brookings Model: Some Further Results, ed. by J. S. Duesenberry, G. Fromm, L. R. Klein, and E. Kuh. Amsterdam: North Holland, 425-456.

Nissen, D. H. (1968): "A Note on the Variance of a Matrix", Econometrica 36, 603-604.

Peters, S. C., and D. A. Freedman (1985): "Using the Bootstrap to Evaluate Forecasting Equations", Journal of Forecasting 4, 251-262.

Prucha, I. R. (1984): "On the estimation or the variance covariance matrix of maximum likelihood estimators in nonlinear simultaneous equation systems: A Monte Carlo study", University of Maryland, Department of Economics, Working Paper No.84-14.

Rao, C. R. (1973): Linear Statistical Inference and its Applications. New York: John Wiley & Sons, Inc.

Schink, G. R. (1971): "Small Sample Estimates of the Variance Covariance Matrix of Forecast Error for Large Econometric Models: The Stochastic Simulation Technique". University of Pennsylvania: Graduate School of Arts and Sciences, Ph. D. Dissertation.

Schmidt, P. (1973): "The Asymptotic Distribution of Dynamic Multipliers", Econometrica 41, 161-164.

Schmidt, P. (1974): "The Asymptotic Distribution of Forecasts in the Dynamic Simulation of an Econometric Model", Econometrica 42, 303-309.

Schmidt, P. (1977): "Some Small Sample Evidence on the Distribution of Dynamic Simulation Forecasts", Econometrica 45, 997-1005.