Vieses orto-heterodoxos e os algoritmos economistas do ChatGPT

Iazdi, Oz (2023): Vieses orto-heterodoxos e os algoritmos economistas do ChatGPT.

Abstract

Recommendations for economic policies can be based on different theoretical perspectives and may present biases that are not always perceptible to the public. Identifying these biases is even more challenging when they are embedded in recommendations coming from sources with high technological and social disruptive potential, where a high level of impartiality is expected, such as contemporary large language models. Thus, a questionnaire was administered to economists affiliated with the Brazilian academic community to assess their perception of the presence of orthodox or heterodox biases in economic policy recommendations derived from interactions with ChatGPT in April 2023. The results showed that: i) there is still no consensus on the concepts of orthodoxy and heterodoxy in Brazil; ii) there are indications of a positive relationship between how self-proclaimed heterodox (orthodox) an economist is and how heterodox (orthodox) the perceived bias in an economic policy is; iii) it was not possible to identify a consistently orthodox or heterodox bias in ChatGPT's recommendations, which exhibited a good degree of impartiality.

• Item Type: MPRA Paper
• English Title: Ortho-Heterodox biases and the economist algorithms of ChatGPT
• Language: Portuguese
• Keywords: ChatGPT, orthodoxy, heterodoxy, biases, economic policy, artificial intelligence.
• Subjects: A - General Economics and Teaching > A1 - General Economics > A13 - Relation of Economics to Social Values; B - History of Economic Thought, Methodology, and Heterodox Approaches > B4 - Economic Methodology > B41 - Economic Methodology; B - History of Economic Thought, Methodology, and Heterodox Approaches > B5 - Current Heterodox Approaches > B50 - General; L - Industrial Organization > L8 - Industry Studies: Services > L86 - Information and Internet Services ; Computer Software

References

AGÊNCIA BRASIL. Recuo da inflação pode fazer juros caírem em 2023, diz ministro. https://agenciabrasil.ebc.com.br/economia/noticia/2022-09/recuo-da-inflacao-pode-fazer-juros-cairem-em-2023-diz-ministro, 20 set. 2022.

BECKENBACH, F. Monism in modern science: the case of economics. Em: Advancing Pluralism in Teaching Economics. [s.l.] Routledge, 2018. p. 31–54.

BORJI, A. A categorical archive of ChatGPT failures. arXiv preprint arXiv:2302.03494, 2023.

CANTU, R. Os valores da intransigência: Premissas normativas e controvérsias econômicas no Brasil. Novos Rumos Sociológicos, v. 9, n. 16, p. 12–51, 2021.

CAPLAN, B. Systematically biased beliefs about economics: Robust evidence of judgemental anomalies from the survey of Americans and economists on the economy. The Economic Journal, v. 112, n. 479, p. 433–458, 2002.

CAPLAN, B.; MILLER, S. C. Intelligence makes people think like economists: Evidence from the General Social Survey. Intelligence, v. 38, n. 6, p. 636–647, 2010.

CARTA CAPITAL. Haddad defende queda na taxa de juros: ‘Não podemos ter medo de tomar as decisões corretas’. https://www.cartacapital.com.br/economia/haddad-defende-queda-na-taxa-de-juros-nao-podemos-ter-medo-de-tomar-as-decisoes-corretas/, 21 mar. 2023.

CNN BRASIL. “O teto é uma bandeira, não é um dogma”, diz Paulo Guedes. https://www.cnnbrasil.com.br/economia/o-teto-e-uma-bandeira-nao-e-um-dogma-diz-paulo-guedes/, 10 ago. 2022.

CNN BRASIL. “Se quem não paga imposto começar a pagar, todos nós pagaremos menos juros”, diz Haddad. https://www.cnnbrasil.com.br/economia/se-quem-nao-paga-imposto-comecar-a-pagar-todos-nos-pagaremos-menos-juros-diz-haddad/, 30 mar. 2023.

COLANDER, D.; HOLT, R.; ROSSER JR, B. The changing face of mainstream economics. Review of Political Economy, v. 16, n. 4, p. 485–499, 2004.

DAVIS, J. B. The nature of heterodox economics. Post-Autistic Economics Review, n. 40, p. 23–30, 2006.

DEQUECH, D. Neoclassical, mainstream, orthodox, and heterodox economics. Journal of Post Keynesian Economics, v. 30, n. 2, p. 279–302, 2007.

DEQUECH, D. Applying the Concept of Mainstream Economics outside the United States: General Remarks and the Case of Brazil as an Example of the Institutionalization of Pluralism. Journal of Economic Issues, v. 52, n. 4, p. 904–924, 2018.

DOBUSCH, L.; KAPELLER, J. Heterodox United vs. Mainstream City? Sketching a framework for interested pluralism in economics. Journal of Economic Issues, v. 46, n. 4, p. 1035–1058, 2012.

DOW, S. C. Plurality in orthodox and heterodox economics. Journal of Philosophical Economics, v. 1, n. 2, p. 73–96, 2008.

DOWLING, M.; LUCEY, B. ChatGPT for (finance) research: The Bananarama conjecture. Finance Research Letters, v. 53, p. 103662, 2023.

FERNANDEZ, R. G.; SUPRINYAK, C. E. Manufacturing pluralism in Brazilian economics. Journal of Economic Issues, v. 53, n. 3, p. 748–773, 2019.

FERRARA, E. Should ChatGPT be biased? Challenges and risks of bias in large language models. arXiv preprint arXiv:2304.03738, 2023.

GILOVICH, T.; GRIFFIN, D.; KAHNEMAN, D. Heuristics and biases: The psychology of intuitive judgment. 1. ed. [s.l.] Cambridge University Press, 2002.

HANDS, D. W. Orthodox and heterodox economics in recent economic methodology. Available at SSRN 1937439, 2011.

HARTMANN, D. S. Ortodoxos e heterodoxos: uma análise do debate através de diferentes metodologias de pesquisa. Revista Iniciativa Econômica, v. 3, n. 2, 2017.

HEISE, A. Defining economic pluralism: ethical norm or scientific imperative. International Journal of Pluralism and Economics Education, v. 8, n. 1, p. 18–41, 2017.

JAVDANI, M.; CHANG, H.-J. Who said or what said? Estimating ideological bias in views among economists. Cambridge Journal of Economics, v. 47, n. 2, p. 309–339, 2023.

KAHNEMAN, D.; SLOVIC, P.; TVERSKY, A. Judgment under uncertainty: Heuristics and biases. [s.l.] Cambridge university press, 1982.

KLAYMAN, J. Varieties of confirmation bias. Psychology of Learning and Motivation, v. 32, p. 385–418, 1995.

KORINEK, A. Language models and cognitive automation for economic research. [s.l.] National Bureau of Economic Research, 2023.

KOUTSOBINAS, T. T. Structural dualism, socio-evolutionary reproduction and the transformation of orthodoxy and heterodoxy in economics. Journal of Economic Methodology, v. 26, n. 4, p. 327–346, 2019.

KVANGRAVEN, I. H.; ALVES, C. Heterodox economics as a positive project: Revisiting the debate. ESRC GPID Research Network Working Paper, v. 19, p. 1–24, 2019.

LAWSON, T. The nature of heterodox economics. Cambridge journal of economics, v. 30, n. 4, p. 483–505, 2006.

LEE, F. A history of heterodox economics: Challenging the mainstream in the twentieth century. [s.l.] Routledge, 2009.

LISBOA, M. D. B.; PESSOA, S. O funcionamento da economia segundo a direita e a esquerda. SP: Folha de S. Paulo, 2016.

MCGEE, R. W. Is chat gpt biased against conservatives? an empirical study. An Empirical Study (February 15, 2023), 2023a.

MCGEE, R. W. How to Determine Your’Fair Share’of Taxes: Ask Chatgpt. Available at SSRN 4413435, 2023b.

MEARMAN, A. ‘Heterodox economics’ and the problems of classification. Journal of Economic Methodology, v. 19, n. 4, p. 407–424, 2012.

MONEY TIMES. Taxa real de juros no Brasil é “fora de propósito”, diz Haddad citando inflação menor e atividade fraca. https://www.moneytimes.com.br/taxa-real-de-juros-no-brasil-e-fora-de-proposito-diz-haddad-citando-inflacao-menor-e-atividade-fraca/, 3 jan. 2023.

NICKERSON, R. S. Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, v. 2, n. 2, p. 175–220, 1998.

NISZCZOTA, P.; ABBAS, S. GPT as a Financial Advisor. Available at SSRN 4384861, 2023.

OPENAI. ChatGPT. , 3 abr. 2023.

PAULA, L. F. DE; JABOUR, F. Texto rebate críticas aos economistas heterodoxos de Lisboa e Pessôa. Folha de São Paulo, v. 21, 2016.

RAY, P. P. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 2023.

ROZADO, D. The political biases of chatgpt. Social Sciences, v. 12, n. 3, p. 148, 2023.

SINGH, S.; RAMAKRISHNAN, N. Is ChatGPT Biased? A Review. Working Paper, 2023.

SIQUEIRA, Á. M.; JERÔNIMO, R. C. Notas críticas sobre o recente debate metodológico entre ortodoxia e heterodoxia na “Ilustríssima”. V Encontro do Programa de Pós-graduação em Economia da UNESP. Anais...2018.

SOUZA LUZ, M. R.; RIBEIRO, M. DOS S. The Dynamics of Encapsulation: Innovation, Annihilation, and Contradiction in Practice. Journal of Economic Issues, v. 56, n. 2, p. 554–561, 2022.