Bayesian Inference in a Non-linear/Non-Gaussian Switching State Space Model: Regime-dependent Leverage Effect in the U.S. Stock Market

Kim, Jaeho (2015): Bayesian Inference in a Non-linear/Non-Gaussian Switching State Space Model: Regime-dependent Leverage Effect in the U.S. Stock Market.

Abstract

This paper provides two Bayesian algorithms to efficiently estimate non-linear/non-Gaussian switching state space models by extending a standard Particle Markov chain Monte Carlo (PMCMC) method. Instead of iteratively running separate PMCMC steps using conventional approaches, the proposed methods generate continuous-state and discrete-regime indicator variables together from their joint smoothing distribution in one Gibbs block. The proposed Bayesian algorithms that are built upon the novel ideas of ancestor sampling and particle rejuvenation are robust to small numbers of particles and degenerate state transition equations. Moreover, the algorithms are applicable to any switching state space models, regardless of the Markovian property. The difficulty in conducting Bayesian model comparisons is overcome by adopting the Deviance Information Criterion (DIC). For illustration, a regime-dependent leverage effect in the U.S. stock market is investigated using the newly developed methods. A conventional regime switching stochastic volatility model is generalized to encompass the regime-dependent leverage effect and is applied to Standard and Poor’s 500 and NASDAQ daily return data. The resulting Bayesian posterior estimates indicate that the stronger (weaker) financial leverage effect is associated with a high (low) volatility regime.

• Item Type: MPRA Paper
• Language: English
• Keywords: Particle Markov Chain Monte Carlo, Regime switching, State space model, Leverage effect
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C11 - Bayesian Analysis: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C15 - Statistical Simulation Methods: General

References

An, Sungbae, and Frank Schorfheide. "Bayesian analysis of DSGE models." Econometric reviews 26.2-4 (2007): 113-172.

Andrieu, Christophe, Arnaud Doucet, and Roman Holenstein. "Particle markov chain monte carlo methods." Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72.3 (2010): 269-342.

Andrieu, Christophe, Manuel Davy, and Arnaud Doucet. "Efficient particle filtering for jump Markov systems. Application to time-varying autoregressions." Signal Processing, IEEE Transactions on 51.7 (2003): 1762-1770.

Bai, Jushan, and Serena Ng. "Boosting diffusion indices." Journal of Applied Econometrics 24.4 (2009): 607-629.

Bandi, Federico M., and Roberto Ren\`{o}. "Time-varying leverage effects." Journal of Econometrics 169.1 (2012): 94-113.

Black, F. "Studies of stock market volatility changes" Proceedings of the American Statistical Association, Business and Economic Statistics Section (1976): pp. 177-181

Bunch, Pete, Fredrik Lindsten, and Sumeetpal Singh. "Particle Gibbs with refreshed backward simulation." Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015.

Carter, Christopher K., Eduardo F. Mendes, and Robert Kohn. "An extended space approach for particle Markov chain Monte Carlo methods." arXiv preprint arXiv:1406.5795 (2014).

Chib, Siddhartha, Federico Nardari, and Neil Shephard. "Markov chain Monte Carlo methods for stochastic volatility models." Journal of Econometrics 108.2 (2002): 281-316.

Christie, Andrew A. "The stochastic behavior of common stock variances: Value, leverage and interest rate effects." Journal of financial Economics 10.4 (1982): 407-432.

Daouk, Hazem, and David Ng. "Is unlevered firm volatility asymmetric?." Journal of Empirical Finance 18.4 (2011): 634-651.

Driessen, Hans, and Yvo Boers. "Efficient particle filter for jump Markov nonlinear systems." IEE Proceedings-radar, sonar and navigation 152.5 (2005): 323-326.

Forni, Mario, Marc Hallin, Marco Lippi, and Lucrezia Reichlin. "The generalized dynamic-factor model: Identification and estimation." Review of Economics and statistics 82.4 (2000): 540-554.

Fruhwirth-Schnatter, Sylvia. Finite mixture and Markov switching models. Springer Science & Business Media, (2006).

Geweke, John. "Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments (with discussion)." Bayesian Statistics 4 (1992): 169-194.

Giordani, Paolo, Robert Kohn, and Dick van Dijk. "A unified approach to nonlinearity, structural change, and outliers." Journal of Econometrics 137.1 (2007): 112-133.

Godsill, Simon J., Arnaud Doucet, and Mike West. "Monte Carlo smoothing for nonlinear time series." Journal of the american statistical association 99.465 (2004).

Gordon, Neil J., David J. Salmond, and Adrian FM Smith. "Novel approach to nonlinear/non-Gaussian Bayesian state estimation." IEE Proceedings F (Radar and Signal Processing). Vol. 140. No. 2. IET Digital Library, 1993.

Hamilton, James D. "A new approach to the economic analysis of nonstationary time series and the business cycle." Econometrica: Journal of the Econometric Society (1989): 357-384.

Harvey, Andrew C., and Neil Shephard. "Estimation of an asymmetric stochastic volatility model for asset returns." Journal of Business & Economic Statistics 14.4 (1996): 429-434.

Kim, Chang-Jin. "Dynamic linear models with Markov-switching." Journal of Econometrics 60.1 (1994): 1-22.

Kim, Chang-Jin, and Charles R. Nelson. State-space models with regime switching: classical and Gibbs-sampling approaches with applications. Vol. 2. Cambridge: MIT press, (1999).

Kim, Chang-Jin, and Jaeho Kim. "Bayesian Inference in Regime-Switching ARMA Models with Absorbing States: The Dynamics of the Ex-Ante Real Interest Rate Under Structural Breaks." Forthcoming Journal of Business \& Economic Statistics (2014).

Kim, Sangjoon, Neil Shephard, and Siddhartha Chib. "Stochastic volatility: likelihood inference and comparison with ARCH models." The Review of Economic Studies 65.3 (1998): 361-393.

Koop, Gary, and Simon M. Potter. "Estimation and forecasting in models with multiple breaks." The Review of Economic Studies 74.3 (2007): 763-789.

Lindsten, Fredrik, Michael I. Jordan, and Thomas B. Schon. "Particle Gibbs with ancestor sampling." The Journal of Machine Learning Research 15.1 (2014): 2145-2184.

Lindsten, Fredrik, Pete Bunch, Sumeetpal S. Singh, and Thomas B. Schon. "Particle ancestor sampling for near-degenerate or intractable state transition models." arXiv preprint arXiv:1505.06356 (2015).

Lindsten, Fredrik, and T. B. Schon. "On the use of backward simulation in the particle Gibbs sampler." Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, (2012).

Liu, Jun S., Wing Hung Wong, and Augustine Kong. "Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes." Biometrika 81.1 (1994): 27-40.

Ludvigson, Sydney C., and Serena Ng. "The empirical risk-return relation: a factor analysis approach." Journal of Financial Economics 83.1 (2007): 171-222.

Mendes, Eduardo F., Christopher K. Carter, and Robert Kohn. "On general sampling schemes for Particle Markov chain Monte Carlo methods." arXiv preprint arXiv:1401.1667 (2014).

Nonejad, Nima. "Particle Gibbs with ancestor sampling for stochastic volatility models with: heavy tails, in mean effects, leverage, serial dependence and structural breaks." Studies in Nonlinear Dynamics & Econometrics (2014).

Omori, Yasuhiro, Siddhartha Chib, Neil Shephard, and Jouchi Nakajima. "Stochastic volatility with leverage: Fast and efficient likelihood inference." Journal of Econometrics 140, no. 2 (2007): 425-449.

Pesaran, M. Hashem, Davide Pettenuzzo, and Allan Timmermann. "Forecasting time series subject to multiple structural breaks." The Review of Economic Studies 73.4 (2006): 1057-1084.

Pitt, Michael K., et al. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter." Journal of Econometrics 171.2 (2012): 134-151.

Pitt, Michael K., and Neil Shephard. "Filtering via simulation: Auxiliary particle filters." Journal of the American statistical association 94.446 (1999): 590-599.

Scott, Steven L. "Bayesian methods for hidden Markov models." Journal of the American Statistical Association 97.457 (2002).

Smets, Frank, and Rafael Wouters. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach." The American Economic Review 97.3 (2007): 586-606.

So, Mike EC P., Kin Lam, and Wai Keung Li. "A stochastic volatility model with Markov switching." Journal of Business & Economic Statistics 16.2 (1998): 244-253.

Song, Dongho. "Bond Market Exposures to Macroeconomic and Monetary Policy Risks." (2014).

Spiegelhalter, David J., Nicola G. Best, Bradley P. Carlin, and Angelika Van Der Linde. "Bayesian measures of model complexity and fit." Journal of the Royal Statistical Society: Series B (Statistical Methodology) 64.4 (2002): 583-639.

Flury, Thomas, and Neil Shephard. "Bayesian inference based only on simulated likelihood: particle filter analysis of dynamic economic models." Econometric Theory 27.05 (2011): 933-956.

Van Dyk, David A., and Taeyoung Park. "Partially collapsed Gibbs samplers: Theory and methods." Journal of the American Statistical Association 103.482 (2008): 790-796.

Wan, Eric A., and Rudolph Van Der Merwe. "The unscented Kalman filter." Kalman filtering and neural networks (2001): 221-280.

Whiteley, Nick. "Discussion on Particle markov chain monte carlo methods." Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72.3 (2010): 306-307.

Whiteley, Nick, Christophe Andrieu, and Arnaud Doucet. "Efficient Bayesian inference for switching state-space models using discrete particle Markov chain Monte Carlo methods." working paper (2010).

Yu, Jun. "On leverage in a stochastic volatility model." Journal of Econometrics 127.2 (2005): 165-178.

Yu, Jun. "A semiparametric stochastic volatility model." Journal of Econometrics 167.2 (2012): 473-482.