Strategies in the repeated prisoner’s dilemma: A cluster analysis

Heller, Yuval and Tubul, Itay (2023): Strategies in the repeated prisoner’s dilemma: A cluster analysis.

Abstract

This study uses k-means clustering to analyze the strategic choices made by participants playing the infinitely repeated prisoner’s dilemma in laboratory experiments. We identify five distinct strategies that closely resemble well-known pure strategies: always defecting, suspicious tit-for-tat, grim, tit-for-tat, and always cooperating. Our analysis reveals moderate systematic deviations of the clustered strategies from their pure counterparts, and these deviations are important for capturing the experimental behavior. Additionally, we demonstrate that our approach significantly enhances the predictive power of previous analyses. Finally, we examine how the frequencies and payoffs of these clustered strategies vary based on the underlying game parameters.

• Item Type: MPRA Paper
• Language: English
• Keywords: k-means clustering, machine-learning, memory, laboratory experiment, repeated games.
• Subjects: C - Mathematical and Quantitative Methods > C7 - Game Theory and Bargaining Theory; C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C91 - Laboratory, Individual Behavior

References

Aoyagi, Masaki, & Fréchette, Guillaume. 2009. Collusion as public monitoring becomes noisy: Experimental evidence. Journal of Economic theory, 144(3), 1135–1165.

Aoyagi, Masaki, Bhaskar, V, & Fréchette, Guillaume R. 2019. The impact of monitoring in infinitely repeated games: Perfect, public, and private. American Economic Journal: Microeconomics, 11(1), 1–43.

Athey, Susan. 2018. The impact of machine learning on economics. Pages 507–547 of: The economics of artificial intelligence: An agenda. University of Chicago Press.

Backhaus, Teresa, & Breitmoser, Yves. 2021. Inequity aversion and limited foresight in the repeated prisoner’s dilemma. Tech. rept. Center for Mathematical Economics Working Papers.

Bigoni, Maria, Casari, Marco, Skrzypacz, Andrzej, & Spagnolo, Giancarlo. 2015. Time horizon and cooperation in continuous time. Econometrica, 83(2), 587–616.

Bigoni, Maria, Casari, Marco, Salvanti, Andrea, Skrzypacz, Andrzej, & Spagnolo, Giancarlo. 2022. It’s Payback time: new insights on cooperation in the repeated prisoners’ dilemma.

Blonski, Matthias, & Spagnolo, Giancarlo. 2015. Prisoners’ other dilemma. International Journal of Game Theory, 44(1), 61–81.

Blonski, Matthias, Ockenfels, Peter, & Spagnolo, Giancarlo. 2011. Equilibrium selection in the repeated prisoner’s dilemma: Axiomatic approach and experimental evidence. American Economic Journal: Microeconomics, 3(3), 164–92.

Breitmoser, Yves. 2015. Cooperation, but no reciprocity: individual strategies in the repeated prisoner’s dilemma. American Economic Review, 105(9), 2882–2910.

Bruttel, Lisa, & Kamecke, Ulrich. 2012. Infinity in the lab. How do people play repeated games? Theory and Decision, 72, 205–219.

Camera, Gabriele, & Casari, Marco. 2009. Cooperation among strangers under the shadow of the future. American Economic Review, 99(3), 979–1005.

Camera, Gabriele, Casari, Marco, & Bigoni, Maria. 2012. Cooperative strategies in anonymous economies: An experiment. Games and Economic Behavior, 75(2), 570–586.

Camerer, Colin F. 2018. Artificial intelligence and behavioral economics. Pages 587–608 of: The economics of artificial intelligence: An agenda. University of Chicago Press.

Cooper, David J, & Kagel, John H. 2022. Using team discussions to understand behavior in indefinitely repeated prisoner’s dilemma games. American Economic Journal: Microeconomics.

Dal Bó, Pedro. 2005. Cooperation under the shadow of the future: experimental evidence from infinitely repeated games. American economic review, 95(5), 1591–1604.

Dal Bó, Pedro, & Fréchette, Guillaume R. 2011. The evolution of cooperation in infinitely repeated games: Experimental evidence. American Economic Review, 101(1), 411–29.

Dal Bó, Pedro, & Fréchette, Guillaume R. 2018. On the determinants of cooperation in infinitely repeated games: A survey. Journal of Economic Literature, 56(1), 60–114.

Dal Bó, Pedro, & Fréchette, Guillaume R. 2019. Strategy Choice in the Infinitely Repeated Prisoner’s Dilemma. American Economic Review, 109(11), 3929–52.

Dhanachandra, Nameirakpam, Manglem, Khumanthem, & Chanu, Yambem Jina. 2015. Image segmentation using K-means clustering algorithm and subtractive clustering algorithm. Procedia Computer Science, 54, 764–771.

Dreber, Anna, Rand, David G, Fudenberg, Drew, & Nowak, Martin A. 2008. Winners don’t punish. Nature, 452(7185), 348–351.

Dreber, Anna, Fudenberg, Drew, & Rand, David G. 2014. Who cooperates in repeated games: The role of altruism, inequity aversion, and demographics.

Journal of Economic Behavior & Organization, 98, 41–55. Duffy, John, & Ochs, Jack. 2009. Cooperative behavior and the frequency of social interaction. Games and Economic Behavior, 66(2), 785–812.

Duffy, John, Hopkins, Ed, & Kornienko, Tatiana. 2021. Facing the Grim Truth: Repeated Prisoner’s Dilemma Against Robot Opponents. Tech. rept. Working Paper.

Ellison, Glenn. 1994. Cooperation in the prisoner’s dilemma with anonymous random matching. The Review of Economic Studies, 61(3), 567–588.

Embrey, Matthew, Fréchette, Guillaume R, & Yuksel, Sevgi. 2018. Cooperation in the finitely repeated prisoner’s dilemma. Quarterly Journal of Economics, 133(1), 509–551.

Fréchette, Guillaume R, & Yuksel, Sevgi. 2017. Infinitely repeated games in the laboratory: Four perspectives on discounting and random termination. Experimental Economics, 20(2), 279–308.

Friedman, Daniel, & Oprea, Ryan. 2012. A continuous dilemma. American Economic Review, 102(1), 337–363.

Fudenberg, Drew, Rand, David G, & Dreber, Anna. 2012. Slow to anger and fast to forgive: Cooperation in an uncertain world. American Economic Review, 102(2), 720–49.

Fudenberg, Drew, Kleinberg, Jon, Liang, Annie, & Mullainathan, Sendhil. 2022. Measuring the completeness of economic models. Journal of Political Economy, 130(4), 956–990.

Fujiwara-Greve, Takako, & Okuno-Fujiwara, Masahiro. 2009. Voluntarily separable repeated prisoner’s dilemma. The Review of Economic Studies, 76(3), 993–1021.

Gill, David, & Rosokha, Yaroslav. 2020. Beliefs, learning, and personality in the indefinitely repeated prisoner’s dilemma. Available at SSRN 3652318.

Goodell, John W, Kumar, Satish, Lim, Weng Marc, & Pattnaik, De- bidutta. 2021. Artificial intelligence and machine learning in finance: Identifying foundations, themes, and research clusters from bibliometric analysis. Journal of Behavioral and Experimental Finance, 32, 100577.

Gow, Ian D, Larcker, David F, & Zakolyukina, Anastasia A. 2022. How important is corporate governance? Evidence from machine learning. Evidence from Machine Learning (September 24, 2022). Chicago Booth Research Paper.

Harsanyi, John, & Selten, Reinhard. 1988. A General Theory of Equilibrium Selection in Games. Tech. rept. The MIT Press. Heller, Yuval, & Mohlin, Erik. 2018.

Observations on cooperation. The Review of Economic Studies, 85(4), 2253–2282.

Hoang, Daniel, & Wiegratz, Kevin. 2022. Machine learning methods in finance: Recent applications and prospects. European Financial Management.

Honhon, Dorothée, & Hyndman, Kyle. 2020. Flexibility and reputation in repeated prisoner’s dilemma games. Management Science, 66(11), 4998–5014.

Kagel, John H, & Schley, Dan R. 2013. How economic rewards affect cooperation reconsidered. Economics Letters, 121(1), 124–127.

Kandori, Michihiro. 1992. Social norms and community enforcement. The Review of Economic Studies, 59(1), 63–80.

Kasberger, Bernhard, Martin, Simon, Normann, Hans-Theo, & Werner, Tobias. 2023. Algorithmic Cooperation. Available at SSRN 4389647.

Kleinberg, Jon, Ludwig, Jens, Mullainathan, Sendhil, & Obermeyer, Ziad. 2015. Prediction policy problems. American Economic Review, 105(5), 491–495.

Kleinberg, Jon, Lakkaraju, Himabindu, Leskovec, Jure, Ludwig, Jens, & Mullainathan, Sendhil. 2018. Human decisions and machine predictions. The quarterly journal of economics, 133(1), 237–293.

Larose, Daniel T, & Larose, Chantal D. 2014. Discovering knowledge in data: an introduction to data mining. Vol. 4. John Wiley & Sons.

Lu, Yi, Lu, Shiyong, Fotouhi, Farshad, Deng, Youping, & Brown, Susan J. 2004. Incremental genetic K-means algorithm and its application in gene expression data analysis. BMC bioinformatics, 5(1), 1–10.

Mengel, Friederike. 2018. Risk and Temptation: A Meta-study on Prisoner’s Dilemma Games. The Economic Journal, 128(616), 3182–3209.

Mengel, Friederike, Orlandi, Ludovica, & Weidenholzer, Simon. 2022. Match length realization and cooperation in indefinitely repeated games. Journal of Economic Theory, 200, 105416.

Mullainathan, Sendhil, & Spiess, Jann. 2017. Machine learning: an applied econometric approach. Journal of Economic Perspectives, 31(2), 87–106.

Ng, HP, Ong, SH, Foong, KWC, Goh, Poh-Sun, & Nowinski, WL. 2006. Medical image segmentation using k-means clustering and improved watershed algorithm. Pages 61–65 of: 2006 IEEE southwest symposium on image analysis and interpretation. IEEE.

Peysakhovich, Alexander, & Naecker, Jeffrey. 2017. Using methods from machine learning to evaluate behavioral models of choice under risk and ambiguity.

Journal of Economic Behavior & Organization, 133, 373–384. Proto, Eugenio, Rustichini, Aldo, & Sofianos, Andis. 2019. Intelligence, personality, and gains from cooperation in repeated interactions. Journal of Political Economy, 127(3), 1351–1390.

Rand, David G, Fudenberg, Drew, & Dreber, Anna. 2015. It’s the thought that counts: The role of intentions in noisy repeated games. Journal of Economic Behavior & Organization, 116, 481–499.

Romero, Julian, & Rosokha, Yaroslav. 2018. Constructing strategies in the indefinitely repeated prisoner’s dilemma game. European Economic Review, 104, 185–219.

Romero, Julian, & Rosokha, Yaroslav. 2023. Mixed Strategies in the Indefinitely Repeated Prisoner’s Dilemma. mimeo.

Sherstyuk, Katerina, Tarui, Nori, & Saijo, Tatsuyoshi. 2013. Payment schemes in infinite-horizon experimental games. Experimental Economics, 16(1), 125–153.

Umargono, Edy, Suseno, Jatmiko Endro, & Gunawan, SK Vincensius. 2020. K-means clustering optimization using the elbow method and early centroid determination based on mean and median formula. Pages 121–129 of: The 2nd International Seminar on Science and Technology (ISSTEC 2019). Atlantis Press.

Umuhoza, Eric, Ntirushwamaboko, Dominique, Awuah, Jane, & Birir, Beatrice. 2020. Using unsupervised machine learning techniques for behavioral-based credit card users segmentation in africa. SAIEE Africa Research Journal, 111(3), 95–101.

Vassilvitskii, Sergei, & Arthur, David. 2006. k-means++: The advantages of careful seeding. Pages 1027–1035 of: Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms.

Vespa, Emanuel. 2020. An experimental investigation of cooperation in the dynamic common pool game. International Economic Review, 61(1), 417–440.

Yuan, Chunhui, & Yang, Haitao. 2019. Research on K-value selection method of K-means clustering algorithm. J, 2(2), 226–235.

Zhang, Libao, Lu, Faming, Liu, An, Guo, Pingping, & Liu, Cong. 2016. Application of K-means clustering algorithm for classification of NBA guards. International Journal of Science and Engineering Applications, 5(1), 1–6.