Nonparametric identification of dynamic multinomial choice games: unknown payoffs and shocks without interchangeability

Otero, Karina V. (2016): Nonparametric identification of dynamic multinomial choice games: unknown payoffs and shocks without interchangeability.

Abstract

This paper proves a nonparametric identification result for a stochastic dynamic discrete choice game of incomplete information. The joint distribution of the private information and the stage game payoffs of the players are both assumed unknown for the econometrician and the private information across alternatives is allowed to have different distributions and be dependent. This setup poses a circularity problem in the identification strategy that has not been solved for dynamic games. This paper proposes a solution through exclusion restrictions and implied properties of the unknown functions. Under the assumptions that the distribution of the private shocks for the outside option is known and the outside option’s shocks are independent of other shocks, the results jointly identify the stage game payoffs and the joint distribution of the private information.

• Item Type: MPRA Paper
• Language: English
• Keywords: dynamic multinomial choice games, dynamic Markov game, Markov decision processes, multiple choice models, econometric identification, incomplete information, dynamic discrete choice, discrete decision process, decision model.
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C14 - Semiparametric and Nonparametric Methods: General; C - Mathematical and Quantitative Methods > C3 - Multiple or Simultaneous Equation Models ; Multiple Variables > C33 - Panel Data Models ; Spatio-temporal Models; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C51 - Model Construction and Estimation; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C57 - Econometrics of Games and Auctions

References

Abbring, J. H. (2010): “Identification of dynamic discrete choice models,” Annual review of economics, 2, 367–394.

Ackerberg, D., C. L. Benkard, S. Berry, and A. Pakes (2007): “Econometric tools for analyzing market outcomes,” Handbook of econometrics , 6, 4171–4276.

Aguirregabiria, V. (2005): “Another Look at the Identification of Dynamic Discrete Decision Processes: With an Application to Retirement Behavior,” Working Paper.

Aguirregabiria, V. (2010): “Another Look at the Identification of Dynamic Discrete Decision Processes: An Application to Retirement Behavior,” Journal of Business & Economic Statistics , 28(2), 201–218.

Aguirregabiria, V., and P. Mira (2002): “Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models,” Econometrica , 70(4), 1519–1543.

Aguirregabiria, V., and P. Mira (2007): “Sequential Estimation of Dynamic Discrete Games,” Econometrica , 75(1), 1–53.

Aguirregabiria, V., and P. Mira (2010): “Dynamic discrete choice structural models: A survey,” Journal of Econometrics, 156(1), 38–67.

Bajari, P., C. L. Benkard, and J. Levin (2007): “Estimating Dynamic Models of Imperfect Competition,” Econometrica , 75(5), 1331–1370.

Bajari, P., V. Chernozhukov, H. Hong, and D. Nekipelov (2009): “Nonparametric and Semiparametric Analysis of a Dynamic Discrete Game,” Unpublished manuscript, Dep. Econ., Univ. Minn., Minneapolis.

Bhattacharya, R. N., and M. Majumdar (1989): “Controlled semi-markov models - the discounted case,” Journal of Statistical Planning and Inference , 21(3), 365–381.

Blevins, J. R. (2014): “Nonparametric identification of dynamic decision processes with discrete and continuous choices,” Quantitative Economics , 5(3), 531–554.

Duggan, J. (2012): “Noisy stochastic games,” Econometrica , 80(5), 2017–2045.

Dutta, P. K., and R. K. Sundaram (1998): “The Equilibrium Existence Problem in General Markovian Games,” in Organization with Incomplete Information, ed. by M. Majumdar, and M. Majumdar, pp. 159–207. Cambridge University Press, Cambridge.

Heckman, J. J., and S. Navarro (2007): “Dynamic discrete choice and dynamic treatment effects,” Journal of Econometrics , 136(2), 341–396.

Hernández-Lerma, O. (1999): Further topics on discrete-time Markov control processes , no. 42 in Applications of mathematics. Springer, New York.

Hotz, V. J., and R. A. Miller (1993): “Conditional Choice Probabilities and the Estimation of Dynamic Models,” The Review of Economic Studies , 60(3), 497–529.

Hotz, V. J., R. A. Miller, S. Sanders, and J. Smith (1994): “A Simulation Estimator for Dynamic Models of Discrete Choice,” The Review of Economic Studies , 61(2), 265–289.

Imai, S., N. Jain, and A. Ching (2009): “Bayesian Estimation of Dynamic Discrete Choice Models,” Econometrica , 77(6), 1865–1899.

Ja´skiewicz, A., and A. S. Nowak (2006): “Zero-Sum Ergodic Stochastic Games with Feller Transition Probabilities,” SIAM J. Control Optim. , 45(3), 773–789.

Ja´skiewicz, A., and A. S. Nowak (2011a): “Discounted dynamic programming with unbounded returns: Application to economic models,” Journal of Mathematical Analysis and Applications, 378(2), 450–462.

Ja´skiewicz, A., and A. S. Nowak (2011b): “Stochastic Games with Unbounded Payoffs: Applications to Robust Control in Economics,” Dynamic Games and Applications, 1(2), 253–279.

Kasahara, H., and K. Shimotsu (2009): “Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices,” Econometrica , 77(1), 135–175.

Kasahara, Katsumi Kasahara, H., and K. Shimotsu (2012): “Sequential Estimation of Structural Models With a Fixed Point Constraint,” ECTA Econometrica , 80(5), 2303–2319.

Keane, M. P., and K. I. Wolpin (1994): “The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence,” The Review of Economics and Statistics , 76(4), 648–672.

K¨uenle, H.-U. (2007): “On Markov Games with Average Reward Criterion and Weakly Continuous Transition Probabilities,” SIAM Journal on Control and Optimization, 45(6), 2156–2168.

Levy, Y. (2013): “Discounted Stochastic Games With No Stationary Nash Equilibrium: Two Examples,” Econometrica , 81(5), 1973–2007.

Lippman, S. A. (1975): “On Dynamic Programming with Unbounded Rewards,” Management Science, 21(11), 1225–1233.

Magnac, T., and D. Thesmar (2002): “Identifying dynamic discrete decision processes,” Econometrica, 70(2), 801–816.

Manski, C. F. (1975): “Maximum score estimation of the stochastic utility model of choice,” Journal of econometrics, 3(3), 205–228.

Manski, C. F. (1985): “Semiparametric analysis of discrete response: Asymptotic properties of the maximum score estimator,” Journal of econometrics, 27(3), 313–333.

Matkowski, J., and A. S. Nowak (2011): “On discounted dynamic programming with unbounded returns,” Economic Theory , 46(3), 455–474.

Matzkin, R. L. (1993): “Nonparametric identification and estimation of polychotomous choice models,” Journal of Econometrics , 58(1–2), 137–168.

Norets, A. (2009): “Inference in Dynamic Discrete Choice Models with Serially Correlated Unobserved State Variables,” Econometrica , 77(5), 1665–1682.

Norets, A. (2010): “Continuity and differentiability of expected value functions in dynamic discrete choice models,” Quantitative Economics , 1(2), 305–322.

Norets, A., and X. Tang (2013): “Semiparametric Inference in Dynamic Binary Choice Models,” The Review of Economic Studies , p. rdt050.

Nowak, A. S. (1985): “Existence of equilibrium stationary strategies in discounted noncooperative stochastic games with uncountable state space,” Journal of Optimization Theory and Applications , 45(4), 591–602.

Pakes, A., M. Ostrovsky, and S. Berry (2007): “Simple estimators for the parameters of discrete dynamic games (with entry/exit examples),” The RAND Journal of Economics , 38(2), 373–399.

Parthasarathy, T. (1982): “Existence of Equilibrium Stationary Strategies in Discounted Stochastic Games,” Sankhy¯a: The Indian Journal of Statistics, Series A (1961-2002) , 44(1), 114–127.

Pesendorfer, M., and P. Schmidt-Dengler (2003): “Identification and Estimation of Dynamic Games,” Working Paper 9726, National Bureau of Economic Research.

Pesendorfer, M., and P. Schmidt-Dengler (2008): “Asymptotic Least Squares Estimators for Dynamic Games,” The Review of Economic Studies, 75(3), 901–928.

Rinc´on-Zapatero, J. P., and C. Rodr´ıguez-Palmero (2003): “Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case,” Econometrica, 71(5), 1519–1555.

Rinc´on-Zapatero, J. P., and C. Rodr´ıguez-Palmero (2009): “Corrigendum to ” Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case”,” Econometrica, 77(1), 317–318.

Rust, J. (1987): “Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher,” Econometrica, 55(5), 999–1033.

Rust, J. (1994): “Structural estimation of Markov decision processes,” Handbook of econometrics, 4(4), 3081–3143.

Srisuma, S. (2013): “Minimum distance estimators for dynamic games,” Quantitative Economics, 4(3), 549–583.

Srisuma, S., and O. Linton (2012): “Semiparametric estimation of Markov decision processes with continuous state space,” Journal of Econometrics, 166(2), 320–341.

Taber, C. R. (2000): “Semiparametric identification and heterogeneity in discrete choice dynamic programming models,” Journal of Econometrics, 96(2), 201–229.