Cumulative knowledge in the social sciences: The case of improving voters' information

Izzo, Federica and Dewan, Torun and Wolton, Stephane (2022): Cumulative knowledge in the social sciences: The case of improving voters' information.

Abstract

wo (non-exhaustive) conditions are necessary for knowledge accumulation: unbiasedness and comparability. Research designs should be unbiased so that researchers obtain correct estimates of an underlying quantity. Empirical specifications should permit comparability so that researchers measure the same quantity across distinct studies. The first condition is covered by the causal revolution, the second is the object of this paper. Using the example of interventions providing additional information to voters, we highlight the difficulty to obtain comparability even after removing all concerns linked to external validity, all statistical noise, and all sources of bias. Commonly used specifications reach comparability only under specific, non-testable conditions. We propose several recommendations to restore comparability.

• Item Type: MPRA Paper
• Language: English
• Keywords: electoral accountability; accumulation of knowledge; comparability; bias; theoretical implications of empirical models
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C18 - Methodological Issues: General; C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs > C80 - General; D - Microeconomics > D7 - Analysis of Collective Decision-Making > D72 - Political Processes: Rent-Seeking, Lobbying, Elections, Legislatures, and Voting Behavior; D - Microeconomics > D8 - Information, Knowledge, and Uncertainty > D80 - General

References

Adida, Claire, Jessica Gottlieb, Eric Kramon, and Gwyneth McClendon. 2021. ``Under What Conditions Does Performance Information Influence Voting Behavior? Lessons from Benin.'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Arias, Eric, Horacio A. Larreguy, John Marshall and Pablo Querubin. Forthcoming. ``When Does Information Increase Electoral Accountability? Lessons from a Field Experiment In Mexico.'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Ashworth, Scott and Kenneth W. Shotts. 2010. ``Does informative media commentary reduce politicians' incentives to pander?." Journal of Public Economics 94(11-12): 838-847.

Ashworth, Scott. 2012. ``Electoral accountability: recent theoretical and empirical work." Annual Review of Political Science 15: 183-201.

Ashworth, Scott and Ethan Bueno de Mesquita. 2014. ``Is voter competence good for voters?: Information, rationality, and democratic performance.'' American Political Science Review. 108(3): 565-587.

Ashworth, Scott, Ethan Bueno de Mesquita, and Amanda Friedenberg. 2017. ``Accountability and information in elections." American Economic Journal: Microeconomics 9(2): 95-138.

Ashworth, Scott, Ethan Bueno de Mesquita, and Amanda Friedenberg. 2018. ``Learning about voter rationality." American Journal of Political Science 62(1): 37-54.

Banerjee, Abhijit V., and Esther Duflo. "The experimental approach to development economics." Annual Review of Economics 1.1 (2009): 151-178.

Bhandari, Abhit, Horacio Larreguy, and John Marshall. 2021. ``Able and Mostly Willing: An Empirical Anatomy of Information's Effect on Voter-Driven Accountability in Senegal.'' American Journal of Political Science, forthcoming.

Bj\"{o}rkman Nyqvist, Martina, Damien de Walque and Jakob Svensson. 2017.``Experimental Evidence on the Long-Run Impact of Community-Based Monitoring.'' American Economic Journal: Applied Economics 9(1): 33–69.

Boas, Taylor C., F. Daniel Hidalgo and Marcus A. Melo. Forthcoming. ``Horizontal but Not Vertical: Accountability Institutions and Electoral Sanctioning in Northeast Brazil.'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Bueno de Mesquita, Ethan and Scott A. Tyson. 2020. ``The Commensurability Problem: Conceptual Difficulties in Estimating the Effect of Behavior on Behavior.'' American Political Science Review 114(2): 375-391.

Buntaine, Mark, Sarah Bush, Ryan Jablonski, Dian Nielson and Paula Pickering. Forthcoming. ``Budgets, SMS Texts, and Votes in Uganda.'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Calvert, Randall L. 1985. ``Robustness of the multidimensional voting model: Candidate motivations, uncertainty, and convergence." American Journal of Political Science 29(1): 69-95.

Canes-Wrone, Brandice, Michael C. Herron, and Kenneth W. Shotts. 2001. ``Leadership and pandering: A theory of executive policymaking." American Journal of Political Science 45(3): 532-550.

Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh. Forthcoming. ``Do Informational Campaigns Promote Electoral Accountability?'', in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Eggers, Andrew C. ``Quality-based explanations of incumbency effects." The Journal of Politics 79(4): 1315-1328.

Ferraz, Claudio and Frederico Finan. 2008. ``Exposing Corrupt Politicians: The Effects of Brazil’s Publicly Released Audits on Electoral Outcomes.'' Quarterly Journal of Economics 123(2):703– 745.

Fox, Justin. 2007. ``Government transparency and policymaking." Public choice 131(1-2): 23-44.

Fox, Justin and Richard Van Weelden. 2012. ``Costly transparency." Journal of Public Economics 96(1-2): 142-150.

Grossman, Guy, Kristin Michelitch, and Carlo Prato. 2022. `` Candidate entry and vote choice in the wake of incumbent performance transparency initiatives.'' Working Paper. Available at \href{https://osf.io/qwcek/}{https://osf.io/qwcek/}.

Hacking, Ian, and Jan Hacking. Representing and intervening: Introductory topics in the philosophy of natural science. Cambridge University Press, 1983.

Incerti, Trevor. 2020. ``Corruption information and vote share: A meta-analysis and lessons for experimental design." American Political Science Review 114(3): 761-774.

Larreguy, Horacio, John Marshall, and James M. Snyder. "Publicizing malfeasance: When the local media structure facilitates electoral accountability in Mexico." The Economic Journal (2020).

Lord Kelvin, Sir William Thomson. 1889. ``'' in \textit{Popular lectures and address}: 73-136. London, UK: MacMillan and Co.

Lierl, Malte and Marcus Holmlund. Forthcoming. ``Performance-Based Voting in Local Elections: Experimental Evidence from Burkina Faso.'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Platas, Melina and Pia Raffler. Forthcoming. ``Meet the Candidates: Field Experimental Evidence on Learning from Politician Debates in Uganda.'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Prat, Andrea. 2005. ``The wrong kind of transparency." American Economic Review 95(3): 862-877.

Sircar, Neelanjan and Simon Chauchard. 2020. ``Dilemmas and Challenges of Citizen Information Campaigns: Lessons from a Failed Experiment in India'' in Dunning, Thad, Guy Grossman, Macartan Humphreys, Susan D. Hyde, and Craig McIntosh (Eds.). \textit{Metaketa I: The Limits of Electoral Accountability}. Cambridge University Press.

Slough, Tara and Scott A. Tyson. 2021. ``External Validity and Meta-Analysis.'' Working Paper. Available at https://drive.google.com/file/d/11G02RN6sOlGJtPaEyCjQlAYE9XL7GNnQ/view.

Wolton, Stephane. 2019.``Are Biased Media Bad for Democracy?." American Journal of Political Science 63(3): 548-562.