Do Personalized AI Predictions Change Subsequent Decision-Outcomes? The Impact of Human Oversight

Gorny, Paul M. and Groos, Eva and Strobel, Christina (2024): Do Personalized AI Predictions Change Subsequent Decision-Outcomes? The Impact of Human Oversight.

Abstract

Regulators of artificial intelligence (AI) emphasize the importance of human autonomy and oversight in AI-assisted decision-making (European Commission, Directorate-General for Communications Networks, Content and Technology, 2021; 117th Congress, 2022). Predictions are the foundation of all AI tools; thus, if AI can predict our decisions, how might these predictions influence our ultimate choices? We examine how salient, personalized AI predictions affect decision outcomes and investigate the role of reactance, i.e., an adverse reaction to a perceived reduction in individual freedom. We trained an AI tool on previous dictator game decisions to generate personalized predictions of dictators’ choices. In our AI treatment, dictators received this prediction before deciding. In a treatment involving human oversight, the decision of whether participants in our experiment were provided with the AI prediction was made by a previous participant (a ‘human overseer’). In the baseline, participants did not receive the prediction. We find that participants sent less to the recipient when they received a personalized prediction but the strongest reduction occurred when the AI’s prediction was intentionally not shared by the human overseer. Our findings underscore the importance of considering human reactions to AI predictions in assessing the accuracy and impact of these tools as well as the potential adverse effects of human oversight.

• Item Type: MPRA Paper
• Language: English
• Keywords: Artificial intelligence, Predictions, Decision-making, Reactance, Free will
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C90 - General; C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C91 - Laboratory, Individual Behavior; D - Microeconomics > D0 - General > D01 - Microeconomic Behavior: Underlying Principles; O - Economic Development, Innovation, Technological Change, and Growth > O3 - Innovation ; Research and Development ; Technological Change ; Intellectual Property Rights > O33 - Technological Change: Choices and Consequences ; Diffusion Processes

References

117th Congress (2022): “Algorithmic Accountability Act of 2022,” https://www.congress.gov/bill/117th-congress/senate-bill/3572, last access: 05/03/2024.

Acemoglu, D. and P. Restrepo (2022a): “Demographics and automation,” Review of Economic Studies, 89, 1–44.

Acemoglu, D. and P. Restrepo (2022b): “Tasks, automation, and the rise in US wage inequality,” Econometrica, 90, 1973–2016.

Adena, M. and A. Hager (2024): “Does online fundraising increase charitable giving? A nationwide field experiment on Facebook,” CESifo Working Paper.

Agarwal, R. and J. Prasad (1998): “A conceptual and operational definition of personal innovativeness in the domain of information technology,” Information Systems Research, 9, 204–215.

Agrawal, A., J. Gans, and A. Goldfarb (2018): Prediction Machines: The Simple Economics of Artificial Intelligence, Harvard Business Press.

Aguirre, E., D. Mahr, D. Grewal, K. De Ruyter, and M. Wetzels (2015): “Unraveling the Personalization Paradox: The Effect of Information Collection and Trust-Building Strategies on Online Advertisement Effectiveness,” Journal of Retailing, 91, 34–49.

Ahn, D. S. and T. Sarver (2013): “Preference for flexibility and random choice,” Econometrica, 81, 341–361.

Ali, S. N., G. Lewis, and S. Vassermann (2023): “Voluntary Disclosure and Personalized Pricing,” Review of Economic Studies, 90, 538–571.

Amir, O., D. G. Rand, and Y. K. Gal (2012): “Economic games on the internet: The effect of $1 stakes,” PLOS One, 7, e31461.

Antoniades, A., G. Seshan, R. Weber, and R. Zubrickas (2018): “Does altruism matter for remittances?” Oxford Economic Papers, 70, 225–242.

Barkai, E. (2023): “Outsmarting ChatGPT to Say What It Really Thinks of Human Kind,” https://www.linkedin.com/pulse/outsmarting-chatgpt-say-what-really-thinks-human-kind-eran-barkai/, last accessed: September 27, 2023.

Baumeister, R. F., E. J. Masicampo, and C. N. Dewall (2009): “Prosocial Benefits of Feeling Free: Disbelief in Free Will Increases Aggression and Reduces Helpfulness,” Personality and Social Psychology Bulletin, 35, 260–268.

Belloni, A., V. Chernozhukov, and C. Hansen (2014): “Inference on treatment effects after selection among high-dimensional controls,” Review of Economic Studies, 81, 608–650.

Beraja, M., A. Kao, D. Y. Yang, and N. Yuchtman (2023a): “AI-tocracy,” The Quarterly Journal of Economics, 138, 1349–1402.

Beraja, M., D. Y. Yang, and N. Yuchtman (2023b): “Data-intensive innovation and the state: Evidence from AI firms in China,” Review of Economic Studies, 90, 1701–1723.

Berger, B., M. Adam, A. Rühr, and A. Benlian (2021): “Watch me improve—algorithm aversion and demonstrating the ability to learn,” Business & Information Systems Engineering, 63, 55–68.

Bhatt, M. P., S. B. Heller, M. Kapustin, M. Bertrand, and C. Blattman (2024): “Predicting and preventing gun violence: An experimental evaluation of READI Chicago,” The Quarterly Journal of Economics, 139, 1–56.

Bigman, Y. E. and K. Gray (2018): “People are averse to machines making moral decisions,” Cognition, 181, 21–34.

Bodner, R. and D. Prelec (2003): “Self-signaling and diagnostic utility in everyday decision making,” The Psychology of Economic Decisions, 1, 26.

Boerman, S. C., S. Kruikemeier, and N. Bol (2021): “When is personalized advertising crossing personal boundaries? How type of information, data sharing, and personalized pricing influence consumer perceptions of personalized advertising,” Computers in Human Behavior Reports, 4, 100144.

Brehm, J. W. (1966): A Theory of Psychological Reactance, Academic Press.

Brehm, J. W., L. K. Stires, J. Sensenig, and J. Shaban (1966): “The Attractiveness of an Eliminated Choice Alternative,” Journal of Experimental Social Psychology, 2, 301–313.

Brehm, S. and J. W. Brehm (1981): “Psychological Reactance: A Theory of Freedom and Control,” Academic Press.

Brock, J. M., A. Lange, and E. Y. Ozbay (2013): “Dictating the risk: Experimental evidence on giving in risky environments,” American Economic Review, 103, 415–437.

Bruns, H., E. Kantorowicz-Reznichenko, K. Klement, M. L. Jonsson, and B. Rahali (2018): “Can nudges be transparent and yet effective?” Journal of Economic Psychology, 65, 41–59.

Bruns, H. and G. Perino (2023): “The role of autonomy and reactance for nudging-experimentally comparing defaults to recommendations and mandates,” Journal of Behavioral and Experimental Economics, 106, 102047.

Burton, S., I. Habli, T. Lawton, J. McDermid, P. Morgan, and Z. Porter (2020): “Mind the gaps: Assuring the safety of autonomous systems from an engineering, ethical, and legal perspective,” Artificial Intelligence, 279, 103201.

Buttrick, N. (2020): “Protective gun ownership as a coping mechanism,” Perspectives on Psychological Science, 15, 835–855.

Caro, F. and A. S. de Tejada Cuenca (2023): “Believing in Analytics: Managers’ Adherence to Price Recommendations from a DSS,” Manufacturing & Service Operations Management, 25, 371–810.

Castelo, N. (2019): Blurring the line between human and machine: marketing artificial intelligence, Columbia University.

Ceccato, S., S. E. Kettner, B. M. Kudielka, C. Schwieren, and A. Voss (2018): “Social preferences under chronic stress,” PLOS One, 13, e0199528.

Chen, D. L., M. Schonger, and C. Wickens (2016): “oTree—An open-source platform for laboratory, online, and field experiments,” Journal of Behavioral and Experimental Finance, 9, 88–97.

Chugunova, M. and D. Sele (2022): “An interdisciplinary review of the experimental evidence on how humans interact with machines,” Journal of Behavioral and Experimental Economics, 99, 101897.

Cochard, F., J. Le Gallo, N. Georgantzis, and J. C. Tisserand (2021): “Social preferences across different populations: Meta-analyses on the ultimatum game and dictator game,” Journal of Behavioral and Experimental Economics, 90, 101613.

Corgnet, B., R. Hernán-Gonzalez, and R. Mateo (2019): “Rac(g)e against the machine? social incentives when humans meet robots,” Working Paper.

Cowgill, B. and E. Zitzewitz (2015): “Corporate prediction markets: Evidence from google, ford, and firm x,” Review of Economic Studies, 82, 1309–1341.

D’agostino, R. B., A. Belanger, and R. B. D’Agostino Jr (1990): “A suggestion for using powerful and informative tests of normality,” The American Statistician, 44, 316–321.

Dai, R., C. Lu, L. Yun, E. Lenze, M. Avidan, and T. Kannampallil (2021): “Comparing stress prediction models using smartwatch physiological signals and participant self-reports,” Computer Methods and Programs in Biomedicine, 208, 106207.

de Groot, J. I. M. (2022): “The personalization paradox in Facebook advertising: The mediating effect of relevance on the personalization–brand attitude relationship and the moderating effect of intrusiveness,” Journal of Interactive Advertising, 22, 57–74.

Dean, M. and J. McNeill (2014): “Preference for flexibility and random choice: an experimental analysis,” Working Paper.

Dekel, E., B. L. Lipman, and A. Rustichini (2001): “Representing preferences with a unique subjective state space,” Econometrica, 69, 891–934.

DellaVigna, S. and D. Pope (2018): “Predicting experimental results: who knows what?” Journal of Political Economy, 126, 2410–2456.

DellaVigna, S., D. Pope, and E. Vivalt (2019): “Predict science to improve science,” Science, 366, 428–429.

Dietvorst, B. J. and S. Bharti (2019): “Risk Seeking Preferences Lead Consumers to Reject Algorithms in Uncertain Domains,” ACR North American Advances, 47, 78–81.

Dietvorst, B. J., J. P. Simmons, and C. Massey (2015): “Algorithm aversion: people erroneously avoid algorithms after seeing them err.” Journal of Experimental Psychology: General, 144, 114.

Dietvorst, B. J., J. P. Simmons, and C. Massey (2018): “Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them,” Management Science, 64, 1155–1170.

Dohmen, T., A. Falk, D. Huffman, U. Sunde, J. Schupp, and G. G. Wagner (2011): “Individual risk attitudes: Measurement, determinants, and behavioral consequences,” Journal of the European Economic Association, 9, 522–550.

Dreber, A., T. Ellingsen, M. Johannesson, and D. G. Rand (2013): “Do people care about social context? Framing effects in dictator games,” Experimental Economics, 16, 349–371.

Drobner, C. and S. J. Goerg (2024): “Motivated belief updating and rationalization of information,” Management Science.

Dunbar, R., A. Frangou, F. Grainger, and E. Pearce (2021): “Laughter influences social bonding but not prosocial generosity to friends and strangers,” PLOS One, 16, e0256229.

Engel, C. (2011): “Dictator games: A meta study,” Experimental Economics, 14, 583–610.

European Commission, Directorate-General for Communications Networks, Content and Technology (2021): “Proposal for a REGULATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL LAYING DOWN HARMONISED RULES ON ARTIFICIAL INTELLIGENCE (ARTIFICIAL INTELLIGENCE ACT) AND AMENDING CERTAIN UNION LEGISLATIVE ACTS,” COM(2021) 206 final, 2021/0106(COD), https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52021PC0206, last access: 05/03/2024.

Falk, A., A. Becker, T. Dohmen, B. Enke, D. Huffman, and U. Sunde (2018): “Global evidence on economic preferences,” The Quarterly Journal of Economics, 133, 1645–1692.

Falk, A. and U. Fischbacher (2006a): “A theory of reciprocity,” Games and Economic Behavior, 54, 293–315.

Falk, A. and U. Fischbacher (2006b): “A theory of reciprocity,” Games and Economic Behavior, 54, 293–315.

Falk, A. and M. Kosfeld (2006): “The hidden costs of control,” American Economic Review, 96, 1611–1630.

Fenzl, T. and T. Brudermann (2021): “Eye cues increase cooperation in the dictator game under physical attendance of a recipient, but not for all,” Journal of Behavioral and Experimental Economics, 94, 101748.

Fornwagner, H., B. Grosskopf, A. Lauf, V. Schöller, and S. Städter (2022): “On the robustness of gender differences in economic behavior,” Scientific Reports, 12, 21549.

Forsythe, R., J. L. Horowitz, N. E. Savin, and M. Sefton (1994): “Fairness in simple bargaining experiments,” Games and Economic Behavior, 6, 347–369.

Fouka, V. (2020): “Backlash: The unintended effects of language prohibition in US schools after World War I,” Review of Economic Studies, 87, 204–239.

Fudenberg, D. and A. Liang (2019): “Predicting and understanding initial play,” American Economic Review, 109, 4112–4141.

Gefen, D. and D. W. Straub (2004): “Consumer trust in B2C e-Commerce and the importance of social presence: experiments in e-Products and e-Services,” Omega, 32, 407–424.

Giannone, D., M. Lenza, and G. E. Primiceri (2021): “Economic predictions with big data: The illusion of sparsity,” Econometrica, 89, 2409–2437.

Goerg, S. J., D. Rand, and G. Walkowitz (2020): “Framing effects in the prisoner’s dilemma but not in the dictator game,” Journal of the Economic Science Association, 6, 1–12.

Gogoll, J. and M. Uhl (2018): “Rage against the machine: Automation in the moral domain,” Journal of Behavioral and Experimental Economics, 74, 97–103.

Grammarly Inc. (2023): “Grammarly,” https://www.grammarly.com, accessed: February 2, 2024.

Guerreiro, J., S. Rebelo, and P. Teles (2022): “Should robots be taxed?” Review of Economic Studies, 89, 279–311.

Güth, W., R. Schmittberger, and B. Schwarze (1982): “An experimental analysis of ultimatum bargaining,” Journal of Economic Behavior & Organization, 3, 367–388.

Habersaat, K. B., C. Betsch, M. Danchin, C. R. Sunstein, R. Böhm, A. Falk, N. T. Brewer, S. B. Omer, M. Scherzer, S. Sah, et al. (2020): “Ten considerations for effectively managing the COVID-19 transition,” Nature Human Behaviour, 4, 677–687.

Han, Y., Y. Liu, and G. Loewenstein (2023): “Confusing context with Character: Correspondence bias in economic interactions,” Management Science, 69, 1070–1091.

Hannah, T. E., E. R. Hannah, and B. Wattie (1975): “Arousal of Psychological Reactance as a Consequence of Predicting an Individual’s Behaviour,” Psychological Reports, 37, 411–420.

Harms, J., K. Liket, J. Protzko, and V. Schölmerich (2017): “Free to help? An experiment on free will belief and altruism,” PLOS One, 12, e0173193.

Hedgcock, W. M., R. S. Rao, and H. A. Chen (2016): “Choosing to Choose: The Effects of Decoys and Prior Choice on Deferral,” Management Science, 62, 2952–2976. Hern, A. (2020): “Berlin artist uses 99 phones to trick Google into traffic jam alert,” https://www.theguardian.com/technology/2020/feb/03/berlin-artist-uses-99-phones-trick-google-maps-traffic-jam-alert, last accessed: September 27, 2023.

Herne, K., J. K. Hietanen, O. Lappalainen, and E. Palosaari (2022): “The influence of role awareness, empathy induction and trait empathy on dictator game giving,” PLOS One, 17, e0262196.

Hertz, N. and E. Wiese (2018): “Under pressure: Examining social conformity with computer and robot groups,” Human Factors, 60, 1207–1218.

Hoffmann, R., T. Chesney, S.-H. Chuah, F. Kock, and J. Larner (2020): “Demonstrability, difficulty and persuasion: An experimental study of advice taking,” Journal of Economic Psychology, 76, 102215.

Hong, S.-M. and S. Faedda (1996): “Refinement of the Hong psychological reactance scale,” Educational and Psychological Measurement, 56, 173–182.

Hong, S.-M. and S. Page (1989): “A psychological reactance scale: Development, factor structure and reliability,” Psychological Reports, 64, 1323–1326.

H&R Block (2023): “H&R Block AI Tax Assist,” https://www.hrblock.com, accessed: February 2, 2024.

Hubmer, J. (2023): “The race between preferences and technology,” Econometrica, 91, 227–261.

Inaba, M., Y. Inoue, S. Akutsu, N. Takahashi, and T. Yamagishi (2018): “Preference and strategy in proposer’s prosocial giving in the ultimatum game,” PLOS One, 13, e0193877.

Intuit Inc. (2023): “Intuit TurboTax,” https://turbotax.intuit.com, accessed: February 2, 2024.

Jeffrey, K. (2021): “Automation and the future of work: How rhetoric shapes the response in policy preferences,” Journal of Economic Behavior & Organization, 192, 417–433.

Jeffrey, K. and K. Matakos (2024): “Automation anxiety, fairness perceptions, and redistribution: Past experiences condition the response to future job loss,” Journal of Economic Behavior & Organization, 221, 174–190.

Jussupow, E., I. Benbasat, and A. Heinzl (2020): “Why are we averse towards algorithms? A comprehensive literature review on algorithm aversion,” European Conference on Information Systems.

Kahneman, D., J. L. Knetsch, and R. H. Thaler (1986): “Fairness and the assumptions of economics,” Journal of Business, 59, 285–300.

Kandul, S. and O. Nikolaychuk (2023): “I win it’s fair, you win it’s not. Selective heeding of merit in ambiguous settings,” PLOS One, 18, e0279865.

Kantar Public (2020): “SOEP-Core-2019: Personenfragebogen, Stichproben A-L3, M1-M2 + N-P,” SOEP Survey Papers 909: Series A.

Kause, A., O. Vitouch, and J. Glück (2018): “How selfish is a thirsty man? A pilot study on comparing sharing behavior with primary and secondary rewards,” PLOS One, 13, e0201358.

Kee, J., M. Knuth, J. N. Lahey, and M. A. Palma (2021): “Does eye-tracking have an effect on economic behavior?” PLOS One, 16, e0254867.

Keeper Tax (2023): “Keeper: AI Tax Assistant,” https://www.keepertax.com, accessed: February 2, 2024.

Kleinberg, J., H. Lakkaraju, J. Leskovec, J. Ludwig, and S. Mullainathan (2018): “Human decisions and machine predictions,” The Quarterly Journal of Economics, 133, 237–293.

Klockmann, V., A. Von Schenk, and M. C. Villeval (2022): “Artificial intelligence, ethics, and intergenerational responsibility,” Journal of Economic Behavior & Organization, 203, 284–317.

Koopmans, T. C. (1962): “On flexibility of future preference,” in Human Judgments and Optimality, ed. by M. W. Shelly and G. L. Bryan., New York: John Wiley and Sons. Kopylov, I. (2009): “Choice deferral and ambiguity aversion,” Theoretical Economics, 4, 199–225.

Kovaleva, A. (2012): The IE-4: Construction and validation of a short scale for the assessment of locus of control, vol. 9, DEU.

Kreps, D. M. (1979): “A representation theorem for “preference for flexibility”,” Econometrica, 565–577.

Krupka, E. and R. A. Weber (2013): “Identifying social norms using coordination games: Why does dictator game sharing vary?” Journal of the European Economic Association, 11, 495–524.

Kumar, M. M., L. Tsoi, M. S. Lee, J. Cone, and K. McAuliffe (2021): “Nationality dominates gender in decision-making in the Dictator and Prisoner’s Dilemma Games,” PLOS One, 16, e0244568.

Kunda, Z. (1990): “The case for motivated reasoning.” Psychological Bulletin, 108, 480. Lazear, E. P., U. Malmendier, and R. A. Weber (2012): “Sorting in experiments with application to social preferences,” American Economic Journal: Applied Economics, 4, 136–163.

Lee, J., H. Davari, J. Singh, and V. Pandhare (2018): “Industrial Artificial Intelligence for industry 4.0-based manufacturing systems,” Manufacturing Letters, 18, 20–23. Li, J., Z. Liao, and R. Quaedvlieg (2022): “Conditional superior predictive ability,” Review of Economic Studies, 89, 843–875.

Little, R. J. and D. B. Rubin (2019): Statistical analysis with missing data, vol. 793, John Wiley & Sons.

Logg, J., J. Minson, and D. Moore (2018): “Robo-Advising: Algorithm Appreciation,” ACR North American Advances, 46, 63–67.

Logg, J. M., J. A. Minson, and D. A. Moore (2019): “Algorithm appreciation: People prefer algorithmic to human judgment,” Organizational Behavior and Human Decision Processes, 151, 90–103.

Longoni, C., A. Bonezzi, and C. K. Morewedge (2019): “Resistance to medical artificial intelligence,” Journal of Consumer Research, 46, 629–650.

Ludwig, J. and S. Mullainathan (2024): “Machine learning as a tool for hypothesis generation,” The Quarterly Journal of Economics, 139, 751–827.

Ma, A., S. Tang, and A. C. Kay (2019): “Psychological reactance as a function of thought versus behavioral control,” Journal of Experimental Social Psychology, 84, 103825.

Malhotra, N. K., S. S. Kim, and J. Agarwal (2004): “Internet users’ information privacy concerns (IUIPC): The construct, the scale, and a causal model,” Information Systems Research, 15, 336–355.

Maltz, A. and S. Rachmilevitch (2021): “A model of menu-dependent evaluations and comparison-aversion,” Journal of Behavioral and Experimental Economics, 91, 101655.

Matsumoto, Y., T. Yamagishi, Y. Li, and T. Kiyonari (2016): “Prosocial behavior increases with age across five economic games,” PLOS One, 11, e0158671.

Mesa-Vázquez, E., I. Rodriguez-Lara, and A. Urbano (2021): “Standard vs random dictator games: On the effects of role uncertainty and framing on generosity,” Economics Letters, 206, 109981.

Microsoft Corporation (2023): “Microsoft Editor,” https://www.microsoft.com/en-us/microsoft-365/microsoft-editor, accessed: February 2, 2024. Mochon, D. (2013): “Single-Option Aversion,” Journal of Consumer Research, 40, 555–566.

Moyal, A. and I. Ritov (2020): “The effect of contest participation and contest outcome on subsequent prosocial behavior,” PLOS One, 15, e0240712.

Mullainathan, S. and Z. Obermeyer (2022): “Diagnosing physician error: A machine learning approach to low-value health care,” The Quarterly Journal of Economics, 137, 679–727.

Nava, F., F. Margoni, N. Herath, and E. Nava (2023): “Age-dependent changes in intuitive and deliberative cooperation,” Scientific Reports, 13, 4457.

Noussair, C. N. and J. Stoop (2015): “Time as a medium of reward in three social preference experiments,” Experimental Economics, 18, 442–456.

Oechssler, J. (2010): “Searching beyond the lamppost: Let’s focus on economically relevant questions,” Journal of Economic Behavior & Organization, 73, 65–67.

Oleszkiewicz, A. and T. Kupczyk (2020): “Sensory impairment reduces money sharing in the Dictator Game regardless of the recipient’s sensory status,” PLOS One, 15, e0230637.

Önkal, D., P. Goodwin, M. Thomson, S. Gönül, and A. Pollock (2009): “The relative influence of advice from human experts and statistical methods on forecast adjustments,” Journal of Behavioral Decision Making, 22, 390–409.

Oosterbeek, H., R. Sloof, and G. Van De Kuilen (2004): “Cultural differences in ultimatum game experiments: Evidence from a meta-analysis,” Experimental Economics, 7, 171–188.

Orpheus Technology Ltd. (2023): “ProWritingAid,” https://prowritingaid.com, accessed: February 2, 2024.

Owens, D., Z. Grossman, and R. Fackler (2014): “The control premium: A preference for payoff autonomy,” American Economic Journal: Microeconomics, 6, 138–161.

Palan, S. and C. Schitter (2018): “Prolific. ac—A subject pool for online experiments,” Journal of Behavioral and Experimental Finance, 17, 22–27.

Palmeira, M. and G. Spassova (2015): “Consumer reactions to professionals who use decision aids,” European Journal of Marketing, 49, 302–326.

Pedregosa, F., G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, et al. (2011): “Scikit-learn: Machine learning in Python,” The Journal of Machine Learning Research, 12, 2825–2830.

Peysakhovich, A., M. A. Nowak, and D. G. Rand (2014): “Humans display a ‘cooperative phenotype’that is domain general and temporally stable,” Nature Communications, 5, 4939.

Pizzi, G., D. Scarpi, and E. Pantano (2021): “Artificial intelligence and the new forms of interaction: Who has the control when interacting with a chatbot?” Journal of Business Research, 129, 878–890.

Poole, D., A. Mackworth, and R. Goebel (1998): Computational Intelligence, Oxford University Press.

Powell, P. A., O. Wills, G. Reynolds, K. Puustinen-Hopper, and J. Roberts (2018): “The effects of exposure to images of others’ suffering and vulnerability on altruistic, trust-based, and reciprocated economic decision-making,” PLOS One, 13, e0194569.

Promberger, M. and J. Baron (2006): “Do patients trust computers?” Journal of Behavioral Decision Making, 19, 455–468.

Raihani, N. J. and K. McAuliffe (2014): “Dictator game giving: The importance of descriptive versus injunctive norms,” PLOS One, 9, e113826.

Rand, D. G., V. L. Brescoll, J. A. Everett, V. Capraro, and H. Barcelo (2016): “Social heuristics and social roles: Intuition favors altruism for women but not for men.” Journal of Experimental Psychology: General, 145, 389.

Rattini, V. (2023): “Worker autonomy and performance: Evidence from a real-effort experiment,” Journal of Economics & Management Strategy, 32, 300–327.

Ritov, I. and T. Kogut (2017): “Altruistic behavior in cohesive social groups: The role of target identifiability,” PLOS One, 12, e0187903.

Rotella, A., A. M. Sparks, S. Mishra, and P. Barclay (2021): “No effect of ‘watching eyes’: An attempted replication and extension investigating individual differences,” PLOS One, 16, e0255531.

Royston, P. (1992): “Comment on sg3.4 and an Improved D’Agostino Test,” Stata Technical Bulletin, 1.

Russell, S. J. and P. Norvig (2010): “Artificial Intelligence: A Modern Approach,” Artificial Intelligence.

Sankaran, S., C. Zhang, H. Aarts, and P. Markopoulos (2021): “Exploring Peoples’ Perception of Autonomy and Reactance in Everyday AI Interactions,” Frontiers in Psychology, 12, 713074.

Selten, R. (1967): “Die Strategiemethode zur Erforschung des eingeschränkt rationalen Verhaltens im Rahmen eines Oligopolexperiments,” Beiträge zur experimentellen Wirtschaftsforschung, 136–168.

Sheng, H. and Y. Chen (2020): “An Empirical Study on Factors influencing Users’ Psychological Reactance to Artificial Intelligence Applications,” in 2020 7th International Conference on Information Science and Control Engineering (ICISCE), IEEE, 234–237.

Spiegel, J. R., M. T. McKenna, G. S. Lakshman, and N. P. G. (2013): “Method and system for anticipatory package shipping,” US Patent No. US8615473B2.

Stagnaro, M. N., A. A. Arechar, and D. G. Rand (2017): “From good institutions to generous citizens: Top-down incentives to cooperate promote subsequent prosociality but not norm enforcement,” Cognition, 167, 212–254.

Stango, V. and J. Zinman (2023): “We Are All Behavioural, More, or Less: A Taxonomy of Consumer Decision-Making,” Review of Economic Studies, 90, 1470–1498.

Steindl, C., E. Jonas, S. Sittenthaler, E. Traut-Mattausch, and J. Greenberg (2015): “Understanding psychological reactance: New developments and findings,” Journal of Psychology, 223, 205–214.

Stock, J. H. and M. W. Watson (2002): “Forecasting using principal components from a large number of predictors,” Journal of the American Statistical Association, 97, 1167–1179.

Thornton, E. M. and L. B. Aknin (2020): “Assessing the validity of the Self versus other interest implicit association test,” PLOS One, 15, e0234032.

Van Buuren, S. (2007): “Multiple imputation of discrete and continuous data by fully conditional specification,” Statistical methods in medical research, 16, 219–242.

Van Petegem, S., B. Soenens, M. Vansteenkiste, and W. Beyers (2015): “Rebels with a cause? Adolescent defiance from the perspective of reactance theory and self-determination theory,” Child Development, 86, 903–918.

Veszteg, R. F., K. Yamakawa, T. Matsubayashi, and M. Ueda (2021): “Acute stress does not affect economic behavior in the experimental laboratory,” PLOS One, 16, e0244881.

von Bieberstein, F., A. Essl, and K. Friedrich (2021): “Empathy: A clue for prosocialty and driver of indirect reciprocity,” PLOS One, 16, e0255071.

von Schenk, A., V. Klockmann, J.-F. Bonnefon, I. Rahwan, and N. Köbis (2022): “Lie detection algorithms attract few users but vastly increase accusation rates,” arXiv preprint arXiv:2212.04277.

Walkowitz, G. (2021): “Dictator game variants with probabilistic (and cost-saving) pay-offs: A systematic test,” Journal of Economic Psychology, 85, 102387.

Waytz, A. and M. I. Norton (2014): “Botsourcing and outsourcing: Robot, British, Chinese, and German workers are for thinking—not feeling—jobs.” Emotion, 14, 434.

Xu, R. (2024): “Persuasion, Delegation, and Private Information in Algorithm-Assisted Decisions,” ArXiv Working Paper 2402.09384.

Ybarra, O., M. C. Keller, E. Chan, S. M. Garcia, J. Sanchez-Burks, K. R. Morrison, and A. S. Baron (2010): “Being unpredictable: Friend or foe matters,” Social Psychological and Personality Science, 1, 259–267.

Yeomans, M., A. Shah, S. Mullainathan, and J. Kleinberg (2019): “Making sense of recommendations,” Journal of Behavioral Decision Making, 32, 403–414.

Zheng, Y., S. M. Van Osselaer, and J. W. Alba (2016): “Belief in free will: Implications for practice and policy,” Journal of Marketing Research, 53, 1050–1064.

Zimmermann, F. (2020): “The dynamics of motivated beliefs,” American Economic Review, 110, 337–363.