What can experiments tell us about how to improve governance?

Gisselquist, Rachel and Niño-Zarazúa, Miguel (2013): What can experiments tell us about how to improve governance? Published in: WIDER Working Paper Series No. 2013/077 (1 August 2013)

Abstract

In recent years, randomized controlled trials have become increasingly popular in the social sciences. In development economics in particular, their use has attracted considerable debate in relation to the identification of ‘what works’ in development policy. This paper focuses on a core topic in development policy: governance. It aims to address two key questions: (1) what have the main contributions of randomized controlled trials been to the study of governance? and (2) what could be the contributions, and relatedly the limits of such methods? To address these questions, a systematic review of experimental and quasi-experimental methods to study government performance was conducted. It identified 139 relevant papers grouped into three major types of policy interventions that aim to: (1) improve supply-side capabilities of governments; (2) change individual behaviour through various devices, notably incentives, and (3) improve informational asymmetries. We find that randomized controlled trials can be useful in studying the effects of some policy interventions in the governance area, but they are limited in significant ways: they are ill-equipped to study broader governance issues associated with macro-structural shifts, national level variation in institutions and political culture, and leadership. Randomized controlled trials are best for studying targeted interventions, particularly in areas of public goods provision, voting behaviour, and specific measures to address corruption and improve accountability; however, they can provide little traction on whether the intervention is transferable and ‘could work’ (and why) in other contexts, and in the longer run.

• Item Type: MPRA Paper
• Language: English
• Keywords: Randomised control trials; governance; development
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C93 - Field Experiments; D - Microeconomics > D7 - Analysis of Collective Decision-Making > D72 - Political Processes: Rent-Seeking, Lobbying, Elections, Legislatures, and Voting Behavior; D - Microeconomics > D7 - Analysis of Collective Decision-Making > D73 - Bureaucracy ; Administrative Processes in Public Organizations ; Corruption; H - Public Economics > H4 - Publicly Provided Goods > H41 - Public Goods

References

Acemoglu, D. and James A. Robinson. 2012. Why Nations Fail: The Origins of Power, Prosperity, and Poverty. New York: Crown Business.

Arndt, Christiane and Charles Oman. 2006. Uses and Abuses of Governance Indicators. Paris: OECD Development Centre.

Banerjee, Abhijit and Esther Duflo. 2012. Poor Economics: A Radical Rethinking of the Way to Fight Global Poverty. New York: PublicAffairs.

Banerjee, Abhijit V., Raghabendra Chattopadhyay, Esther Duflo, Daniel Keniston, and Nina Singh. 2012. ‘Can Institutions Be Reformed from Within? Evidence from a Randomized Experiment with the Rajasthan Police.’

Banerjee, Abhijit Vinayak. 2007. ‘Making Aid Work.’ Pp. 1-26 in Making Aid Work, edited by A. V. Banerjee. Cambridge, Mass.: MIT Press.

Basinga, Paulin, Paul J. Gertler, Agnes Binagwaho, Agnes L. B. Soucat, Jennifer Sturdy, and Christel M. J. Vermeersch. 2011. ‘Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation.’ The Lancet 377:1421-1428.

Björkman, Martina and Jakob Svensson. 2009. ‘Power to the People: Evidence from a Randomized Field Experiment on Community-Based Monitoring in Uganda.’ The Quarterly Journal of Economics 124:735-769.

Collier, Paul and Pedro C. Vicente. 2008. ‘Votes and Violence: Evidence from a Field Experiment in Nigeria.’

De La O, Ana. 2008. ‘Do Poverty Relief Funds Affect Electoral Behavior? Evidence from a Randomized Experiment in Mexico.’ Field Experiments in Comparative Politics and Policy, University of Manchester.

Deaton, Angus. 2009. ‘Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development ‘ in Research Program in Development Studies, Center for Health and Wellbeing Princeton University

Dee, Thomas S. 2011. ‘Conditional cash penalties in education: Evidence from the Learnfare experiment.’ Economics of Education Review 30:924-937.

Duflo, Esther and Rema Hanna. 2005. ‘Monitoring Works: Getting Teachers to Come to School.’ National Bureau of Economic Research Working Paper Series No. 11880.

Friedman, Milton. 1962. Capitalism and Freedom. Chicago: University Of Chicago Press.

Gans-Morse, Jordan and Simeon Nichter. 2008. ‘Economic Reforms and Democracy Evidence of a J-Curve in Latin America.’ Comparative Political Studies 41:1398-1426.

Gisselquist, Rachel M. 2012. ‘Good Governance as a Concept, and Why this Matters for Development Policy.’ United Nations University-World Institute for Development Economics Research (UNU-WIDER), Helsinki.

Gisselquist, Rachel, Miguel Niño-Zarazúa, and Javier Sajuria Miguel (forthcoming)’ ‘Improving Government Performance in Developing Countries. A Systematic Review, in WIDER Working Paper Series.

Glennerster, Rachel and Michael Kremer. 2011. ‘Small Changes, Big Results: Behavioral Economics at Work in Poor Countries.’ Boston Review: A Political and Literary Forum.

Goldin, Kenneth D. 1977. ‘Equal access vs. Selective access: A critique of public goods theory.’ Public Choice 29:53-71.

Grindle, Merilee S. 2010. ‘Good Governance: The Inflation of an Idea.’ in Faculty Research Working Paper Series, RWP 10-023, Harvard Kennedy School.

Herbst, Jeffrey. 2000. States and Power in Africa: Comparative Lessons in Authority and Control Princeton: Princeton University Press.

Horowitz, Donald L. 1985. Ethnic Groups in Conflict. Berkeley: University of California Press.

Horowitz, Donald L. 1992. A Democratic South Africa? Constitutional Engineering in a Divided Society (Berkeley: University of California Press.

Humphreys, Macartan and Jeremy M. Weinstein. 2009. "Field Experiments and the Political Economy of Development." The Annual Review of Political Science 12:367-378.

Hyde, Susan D. 2010a. ‘Experimenting in Democracy Promotion: International Observers and the 2004 Presidential Elections in Indonesia.’ Perspectives on Politics 8:511-527.

—. 2010b. ‘The Future of Field Experiments in International Relations.’ The ANNALS of the American Academy of Political and Social Science 628:72-84.

Ichino, Nahomi and Matthias Schündeln. 2012. ‘Deterring or Displacing Electoral Irregularities? Spillover Effects of Observers in a Randomized Field Experiment in Ghana.’ The Journal of Politics 74:292-307.

Immergut, Ellen M. 1992. Health Politics: Interests and Institutions in Western Europe. Cambridge: Cambridge University Press.

Jackson, R.H. and C.G. Rosberg. 1982. Personal Rule in Black Africa. Los Angeles: UCLA Press.

Karlan, Dean and Jacob Appel. 2012. More Than Good Intentions: Improving the Ways the World's Poor Borrow, Save, Farm, Learn, and Stay Healthy. New York: Plume.

Kaufmann, Daniel, Aart Kraay, and Pablo Zoido-Lobaton. 1999. ‘Governance Matters.’ in World Bank Policy Research Working Paper 2196.

Keefer, Philip. 2009. ‘Governance.’ Pp. 439-462 in The Sage Handbook of Comparative Politics, edited by T. Landman and N. Robinson. London: Sage.

Keynes, John M. 1964. The General Theory of Employment, Interest, and Money. London: Harcourt Brace Jovanovich.

Kingdon, John W. 1995. Agendas, Alternatives, and Public Policies. 2nd ed. New York: HarperCollins.

Kirkpatrick, Colin. 2012. ‘Economic Governance: Improving the economic and regulatory environment for supporting private sector activity.’ UNU-WIDER, Helsinki.

Kremer, Michael, Edward Miguel, and Rebecca Thornton. 2009. ‘Incentives to Learn.’ Review of Economics and Statistics 91:437-456.

Leroy, Jef L., Armando García-Guerra, Raquel García, Clara Dominguez, Juan Rivera, and Lynnette M. Neufeld. 2008. ‘The Oportunidades Program Increases the Linear Growth of Children Enrolled at Young Ages in Urban Mexico.’ The Journal of Nutrition 138:793-798.

Levi, Margaret. 2006. ‘Why We Need A New Theory of Government.’ Perspectives on Politics 4:5-19.

Lijphart, Arend. 1977. Democracy in Plural Societies: A Comparative Exploration. New Haven: Yale University Press. Lipset, S.M. 1981. Political man: the social bases of politics: Johns Hopkins University Press.

Luebbert, Gregory M. 1991. Liberalism, Fascism, or Social Democracy : Social Classes and the Political Origins of Regimes in Interwar Europe. Oxford: Oxford University Press.

Martel Garcia, Fernando and Leonard Wantchekon. 2010. ‘Theory, External Validity, and Experimental Inference: Some Conjectures.’ The ANNALS of the American Academy of Political and Social Science 628:132-147.

Migdal, Joel. 1988. Strong Societies and Weak States: State-Society Relations and State Capabilities in the Third World. Princeton: Princeton University Press.

Miguel, Edward and Michael Kremer. 2004. ‘Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities.’ Econometrica 72:159-217.

Moehler, Devra C. 2010a. ‘Democracy, Governance, and Randomized Development Assistance.’ The ANNALS of the American Academy of Political and Social Science 628:30-46.

—. 2010b. ‘Democracy, Governance, and Randomized Development Assistance.’ The ANNALS of the American Academy of Political and Social Science 628:30-46.

Moore, Barrington. 1966. Social Origins of Dictatorship and Democracy: Lord and Peasant in the Making of the Modern World. New York: Beacon Press.

North, Douglass C. 1990. Institutions, Institutional Change and Economic Performance. Cambridge: Cambridge University Press.

Olken, Benjamin A. and Rohini Pande. 2011a. "Corruption in Developing Countries." in NBER Working Paper Series. Cambridge, MA: National Bureau of Economic Research.

Olken, Benjamin A. and Rohini Pande. 2011b. "Governance Review Paper." in J-PAL Governance Initiative: Abdul Latif Jameel Poverty Action Lab.

Olken, Benjamin A. 2010. ‘Direct Democracy and Local Public Goods: Evidence from a Field Experiment in Indonesia.’ American Political Science Review 104:243-267.

Olken, Benjamin A. 2007. ‘Monitoring Corruption: Evidence from a Field Experiment in Indonesia.’ Journal of Political Economy 115:200-249.

Pandey, Priyanka, Sangeeta Goyal, and Venkatesh Sundararaman. 2009. ‘Community participation in public schools: impact of information campaigns in three Indian states.’ Education Economics 17:355-375.

Pattanayak, Subhrendu K, Jui-Chen Yang, Katherine L Dickinson, Christine Poulos, Sumeet R Patil, Ranjan K Mallick, Jonathan L Blitstein, and Purujit Praharaj. 2009. ‘Shame or subsidy revisited: social mobilization for sanitation in Orissa, India.’ Bulletin of the World Health Organization 87:580–587.

Przeworski, Adam and Fernando Limongi. 1997. ‘Modernization: Theories and Facts.’ World Politics 49:155-183.

Przeworski, Adam, Michael E. Alvarez, Jose Antonio Cheibub, and Fernando Limongi. 2000. Democracy and Development: Political Institutions and Well-being in the World, 1950-1990. New York: Cambridge University Press.

Putnam, Robert. 19934. Making Democracy Work: Civic Traditions in Modern Italy. New York: Princeton University Press

Quimbo, Stella A., John W. Peabody, Riti Shimkhada, Jhiedon Florentino, and Orville Solon. 2011. ‘Evidence of a causal link between health outcomes, insurance coverage, and a policy to expand access: experimental data from children in the Philippines.’ Health Economics 20:620-630.

Ravallion, Martin. 2009. ‘Should the Randomistas Rule?’ Economists' Voice 6.

Reilly, Benjamin. 2001. Democracy in Divided Societies: Electoral Engineering for Conflict Management. Cambridge: Cambridge University Press.

Rothstein, B. O. and J. A. N. Teorell. 2008. ‘What Is Quality of Government? A Theory of Impartial Government Institutions.’ Governance 21:165-190.

Samuels, Richard J. 2003. Machiavelli's Children: Leaders and Their Legacies in Italy and Japan. Ithaca: Cornell University Press.

Samuelson, Paul A. 1954. ‘The Pure Theory of Public Expenditure.’ The Review of Economics and Statistics 36:387-389.

Sartori, Giovanni. 1997. Comparative Constitutional Engineering: An Inquiry into Structures, Incentives, and Outcomes. New York: New York University Press.

Skocpol, Theda. 1979. States and Social Revolutions: A Comparative Analysis of France, Russia and China. Cambridge: Cambridge University Press.

Stecklov, Guy, Paul Winters, Jessica Tood, and Ferdinando Regalia. 2007. ‘Unintended effects of poverty programmes on childbearing in less developed countries: Experimental evidence from Latin America.’ Population Studies 61:125-140.

Steinmo, Sven. 2008. ‘Historical Institutionalism.’ Pp. 113-138 in Approaches and Methodologies in the Social Sciences: A Pluralist Perspective, edited by D. Della Porta and M. Keating. Cambridge UK: Cambridge University Press.

Thomas, M. A. 2009. ‘What Do the Worldwide Governance Indicators Measure?’ European Journal of Development Research 22:31-54.

Tocqueville, Alexis de. 2003. Democracy in America and Two Essays on America. Translated by Gerald E. Bevan. London: Penguin Books.

Wantchekon, Leonard. 2003. ‘Clientelism and Voting Behavior: Evidence from a Field Experiment in Benin.’ World Politics 55:399-422.

—. 2009. ‘Can Informed Public Deliberation Overcome Clientelism? Experimental Evidence from Benin.’ New York.

Weber, Max. 2009. ‘Politics as a Vocation.’ Pp. 77-128 in From Max Weber: Essays in Sociology, edited by H.H. Gerth and C. Wright Mills (Abingdon: Routledge).

World Bank. 2012. ‘Strengthening Governance: Tackling Corruption. The World Bank Group's Updated Strategy and Implementation Plan.’ World Bank, Washington, DC.