Spiliopoulos, Leonidas (2009): Pattern recognition and subjective belief learning in repeated mixed strategy games.
This is the latest version of this item.
Download (517Kb) | Preview
This paper aspires to fill a conspicuous gap in the existing literature on learning in games, namely the absence of any empirical verification of learning rules involving pattern recognition. An extension of weighted fictitious play is proposed both obeying cognitive laws of subjective perception, and allowing for two-period pattern detection of opponents' behavior. The unconditional prior probability of a subject employing a pattern detecting belief model is 0.34, as estimated by a mixture (latent-class) model of the elicited belief and action data series from Nyarko and Schotter (2002), or 0.551 using only action data. The conditional prior probability of using pattern recognition was found to depend positively on a measure of the exploitable two-period patterns in an opponent's action choices, in stark contrast to the minimax hypothesis. Also, standard weighted fictitious play models are found to significantly bias memory parameter estimates upwards, compared to the proposed subjective fictitious play models. Finally, simulations of learning models reveal that the simple win-stay/lose-shift heuristic may be effective even against more complex pattern detecting models.
|Item Type:||MPRA Paper|
|Institution:||University of Sydney|
|Original Title:||Pattern recognition and subjective belief learning in repeated mixed strategy games|
|Keywords:||Behavioral game theory; Learning; Fictitious play; Pattern detection; Simulations; Beliefs; Repeated games; Mixed Strategy Nash equilibria; Economics and psychology; Agent based computational economics|
|Subjects:||C - Mathematical and Quantitative Methods > C9 - Design of Experiments
C - Mathematical and Quantitative Methods > C6 - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling > C63 - Computational Techniques; Simulation Modeling
C - Mathematical and Quantitative Methods > C7 - Game Theory and Bargaining Theory > C73 - Stochastic and Dynamic Games; Evolutionary Games; Repeated Games
C - Mathematical and Quantitative Methods > C7 - Game Theory and Bargaining Theory > C72 - Noncooperative Games
|Depositing User:||Leonidas Spiliopoulos|
|Date Deposited:||17. Jul 2009 00:20|
|Last Modified:||11. Feb 2013 10:43|
Aoyagi, M. (1996). Evolution of Beliefs and the Nash Equilibrium of Normal Form Games. Journal of Economic Theory 70 (2), 444–469.
Bar-Hillel, M. and W. Wagenaar (1991). The perception of randomness. Advances in Applied Mathematics 12 (4), 428–454.
Binmore, K., J. Swierzbinski, and C. Proulx (2001). Does Minimax Work? An Experimental Study. Economic Journal 111 (473), 445–464.
Bloomﬁeld, R. (1994). Learning a mixed strategy equilibrium in the laboratory. Journal of Economic Behavior & Organization 25 (3), 411–436.
Brown, J. N. and B. W. Rosenthal (1990). Testing the minimax hypothesis: A re-examination of O’Neill’s game experiment. Econometrica 38, 1065–81.
Cabrales, A. and W. Garcia-Fontes (2000). Estimating learning models from experimental data. University of Pompeu Fabra working paper .
Camerer, C. (2003). Behavioral game theory: Experiments in strategic interaction. Princeton University Press.
Camerer, C. F. and T. Ho (1999). Experience-weighted attraction learning in normal-form games. Econometrica 67, 827–74.
Cheung, Y. W. and D. Friedman (1997). Individual learning in normal form games: Some laboratory results. Games and Economic Behavior 19, 46–76.
Chiappori, P. A., S. Levitt, and T. Groseclose (2002). Testing mixed strategy equilibria when players are heterogeneous: The case of penalty kicks in soccer. American Economic Review 92 (4), 1138–1151.
Cleeremans, A., A. Destrebecqz, and M. Boyer (1998). Implicit learning: news from the front. Trends in Cognitive Sciences 2 (10), 406–416.
Clegg, B., G. DiGirolamo, and S. Keele (1998). Sequence learning. Trends in Cognitive Sciences 2 (8), 275–281.
Fudenberg, D. and D. K. Levine (1998). The Theory of Learning in Games (Economics Learning and Social Evolution). Cambridge: MIT Press.
Gigerenzer, G. (2000). Adaptive thinking: Rationality in the real world. New York: Oxford University Press.
Gigerenzer, G. and R. Selten (Eds.) (2001). Bounded rationality: The adaptive toolbox. Cambridge, MA: MIT Press.
Goldstein, W. and H. Einhorn (1987). Expression theory and the preference reversal phenomena. Psychological review 94 (2), 236–254.
Gomez, R. L. (1997). Transfer and complexity in artiﬁcial grammar learning. Cognitive Psychology 33, 154–207.
Gonzalez, R. and G. Wu (1999). On the Shape of the Probability Weighting Function. Cognitive Psychology 38 (1), 129–166.
Kagel, J. H. and A. E. Roth (Eds.) (1995). The Handbook of Experimental Economics. Princeton University Press.
Kilka, M. and M. Weber (2001). What Determines the Shape of the Probability Weighting Function Under Uncertainty? Management Science 47 (12), 1712.
Lattimore, P., J. Baker, and A. Witte (1995). The inﬂuence of probability on risky choice-A parametric examination. Journal of Economic Behavior and Organization 17 (3), 377–400.
Levitt, S., J. List, and D. Reiley (2008). What happens in the ﬁeld stays in the ﬁeld: Professionals do not play minimax in laboratory experiments. University of Arizona, Working paper .
Martignon, L. and K. Laskey (1999). Simple Heuristics That Make Us Smart, pp. 169–188. Oxford University Press.
McKelvey, R. D. and T. R. Palfrey (1995). Quantal response equilibria for normal form games. Games and Economic Behavior 7, 6–38.
Nissen, M. and P. Bullemer (1987). Attentional requirements of learning: evidence from performance measures. Cognitive psychology 19 (1), 1–32.
Nyarko, Y. and A. Schotter (2002). An experimental study of belief learning using elicited beliefs. Econometrica 70 (3), 971.
Palacios-Huerta, I. (2003). Professionals play minimax. Review of Economic Studies 70, 395–415.
Palacios-Huerta, I. and O. Volij (2008). Experientia docet: Professionals play minimax in laboratory experiments. Econometrica 76 (1), 71–115.
Rapoport, A. and D. Budescu (1997). Randomization in individual choice behavior. Psychological Review 104 (603- 617).
Remillard, G. (2007). Implicit learning of second-, third-, and fourth-order adjacent and nonadjacent sequential dependencies. The Quarterly Journal of Experimental Psychology 1.
Remillard, G. and J. M. Clark (2001). Implicit learning of First-, Second-, and Third-Order Transition Probabilities. Journal of Experimental Psychology: Learning, Memory and Cognition 27 (2), 483–498.
Roth, A. E. and I. Erev (1995). Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term. Games and Economic Behavior 8 (1), 164–212.
Salmon, T. C. (2001). An Evaluation of Econometric Models of Adaptive Learning. Econometrica 69 (6), 1597–1628.
Selten, R. (1991). Anticipatory learning in two-person games. Game Equilibrium Models: Evolution and game dynamics/with contributions by I. Eshel...[et al , 98.
Shachat, J. and T. J. Swarthout (2004). Do we detect and exploit mixed strategy play by opponents? Mathematical Methods of Operations Research 59 (3), 359–373.
Sklar, A. (1973). Random variables, distribution functions, and copulas. Kybernetica 9 (449 – 460).
Sonsino, D. (1997). Learning to Learn, Pattern Recognition, and Nash Equilibrium. Games and Economic Behavior 18 (2), 286–331.
Spiliopoulos, L. (2008). Humans versus computer algorithms in repeated mixed strategy games. Available at SSRN: http://ssrn.com/abstract=970418 .
Titterington, D. (1990). Some recent research in the analysis of mixture distributions. Statistics 21 (4), 619–641.
Tversky, A. and C. Fox (1995). Weighing Risk and Uncertainty. Psychological review 102 (2), 269–283.
Walker, M. and J. Wooders (2001). Minimax play at wimbledon. American Economic Review , 1521–38.
Available Versions of this Item
Do repeated game players detect patterns in opponents? Revisiting the Nyarko & Schotter belief elicitation experiment. (deposited 09. Jan 2008 01:39)
- Pattern recognition and subjective belief learning in repeated mixed strategy games. (deposited 17. Jul 2009 00:20) [Currently Displayed]