Causal Inference and the Millennium Development Goals (MDGs): Assessing Whether There Was an Acceleration in MDG Development Indicators Following the MDG Declaration

Friedman, Howard Steven (2013): Causal Inference and the Millennium Development Goals (MDGs): Assessing Whether There Was an Acceleration in MDG Development Indicators Following the MDG Declaration.

Abstract

Background: The Millennium Development Goals (MDGs) are a set of eight goals and corresponding indicators that were agreed to following the adoption of the United Nations Millennium Declaration in September 2000 by leaders of 189 countries. The goals state specific objectives for the world to accomplish by measuring progress in indicators during the time period from 1990 (ten years before the declaration) to 2015. While monitoring mechanisms have reported the progress towards achieving these goals, there has been little effort to evaluate whether there was a change in the development outcomes associated with the activities initiated by the MDGs. The dearth of evaluations applied to the MDGs may be associated with the lack of a true counterfactual or the challenges with the data quality. Our analysis focused on the questions of whether there was a statistically significant acceleration or deceleration (mathematically defined as an interrupted slope or intercept) for a particular indicator and, if there was one, whether that changepoint occurred before or after 2001. Accelerations occurring in 2000 or earlier cannot be causally associated with the MDG-related activities (since the acceleration predated the declaration) while accelerations after 2000 may logically be associated with MDG-related activities.

Method: We applied the standard program evaluation methodology of an interrupted time series to the country level yearly measurements of the MDG indicators as well as a set of control indicators that were not included in the set of MDG indicators (and were not likely to have been directly impacted by MDG-related activities). The modeling technique used was a multiple linear mixed model where we identified the optimal year of the changepoint in the outcome by examining years 1992 to 2008 for all datasets. Analysis was performed separately for IDA-only countries (World Bank 2000 designation) as well as for a broader set of countries consisting of IDA, IBRD and Blend countries. The IDA (International Development Association) focuses on low income countries and the IBRD (International Bank for Reconstruction and Development) focuses on middle income countries. The primary data source for the analysis was the World Bank database where the analysis explicitly assumes that the reported data points are accurate. Reported results contain separate analyses for (1) including heavy influence countries and (2) excluding heavy influence countries; thus resulting in four sets of reported analyses as well as a detailed review of the individual MDG indicator.

Results: The general result was that there was no trend in statistically significant accelerations in the MDG indicators after 2000. Rather the results for all four sets of reported analysis were consistent in that about half of the MDG indicators exhibited no acceleration or deceleration during the time period from 1992 to 2008 and about one-third exhibited accelerations BEFORE 2001. Contrarily, nearly all of the control indicators had no change (neither acceleration nor deceleration) during the time period. It should be emphasized that the control indicators were identified based on data availability and other control indicators may exist that serve as more appropriate controls.

The only MDG indicator that had a statistically significant acceleration in progress in 2001 or after for all four datasets was Indicator 8D (Debt Service). MDG indicators 1B (GDP per person employed), 4A (Infant Mortality Rate), 4A (Under-five mortality rate), and 6A (HIV prevalence among population aged 15-24 years) all had statistically significant accelerations in 2000 or earlier for all four sets of analysis.

Discussion: The results may reflect some of the historical nature of the MGDs in that the Millennium Declaration represented a culmination of development agreements and goals that had been established over the preceding years. As such, many of the indicators selected to belong to the MDGs in 2000 had been previously identified in the global development agenda in the 1990s and campaigns to accelerate progress had been initiated before 2000. In fact, when the results of this study have been demonstrated at different United Nations forums, the reaction from seasoned development professionals has consistently been that of affirmation, where the audience generally has indicated that intuitively they would have expected the observed results given their knowledge of how the MDG indicators had been identified. Additionally, the results may be indicative of the impact of long-term broader economic trends where, for example, official development assistance (ODA) comprises only a very minor part of the global economy.

Conclusion: In order to ensure ongoing global support for development, especially as the global development community looks beyond 2015 to the post-MDG era, there needs to be careful communication regarding what the MDGs did and did not accomplish. Many of those who are not development professionals have been drawn into the global discussions due to the strong communications support for the Millennium Development Goals. As such, much of the general public expects that an acceleration in progress was triggered following the September 2000 Declaration and the associated increase in ODA. Contrarily, the data show clearly that the activities following the MDG Declaration did not provide an acceleration in most of the development goals. For the subset of MDG indicators that experienced an acceleration, the accelerations tended to occur before the MDG Declaration. This does not preclude the possibility that activities associated with the MDGs helped sustain accelerations that predated the September 2000 MDG Declaration or ward off decelerations. Additionally, this does not preclude the possibility that the MDGS provided an acceleration post-2000 in a subset of countries (i.e. sub-Saharan Africa or heavily ODA dependent countries) but it is important to note that this study examined the broadest question regarding the impact of the MDGs on the entire set of developing countries rather than a selected subset.

• Item Type: MPRA Paper
• Language: English
• Keywords: Millennium Development Goals; MDGs; ODA; Interrupted Time Series; Quasi-experimental; Official Development Assistance; Development Economics; MDG Declaration
• Subjects: A - General Economics and Teaching > A1 - General Economics; F - International Economics > F0 - General; F - International Economics > F6 - Economic Impacts of Globalization; F - International Economics > F6 - Economic Impacts of Globalization > F63 - Economic Development; F - International Economics > F6 - Economic Impacts of Globalization > F64 - Environment; H - Public Economics > H5 - National Government Expenditures and Related Policies; H - Public Economics > H5 - National Government Expenditures and Related Policies > H50 - General; I - Health, Education, and Welfare > I0 - General; I - Health, Education, and Welfare > I1 - Health; I - Health, Education, and Welfare > I2 - Education and Research Institutions; I - Health, Education, and Welfare > I3 - Welfare, Well-Being, and Poverty; I - Health, Education, and Welfare > I3 - Welfare, Well-Being, and Poverty > I32 - Measurement and Analysis of Poverty; I - Health, Education, and Welfare > I3 - Welfare, Well-Being, and Poverty > I38 - Government Policy ; Provision and Effects of Welfare Programs; O - Economic Development, Innovation, Technological Change, and Growth > O2 - Development Planning and Policy; O - Economic Development, Innovation, Technological Change, and Growth > O2 - Development Planning and Policy > O21 - Planning Models ; Planning Policy

References

Attaran, Amir. "An Immeasurable Crisis? A Criticism of the Millennium Development Goals and Why They Cannot Be Measured." PLoS Med 2(10) (2005).

Chhabra, Ritu and Claudia Rokx. "The Nutrition MDG Indicator - Interpreting Progress." HNP Discussion Paper. 2004.

Economic Commission for Europe. The Millenium Development Goals - The Way Ahead. New York and Geneva: United Nations, 2006. http://www.unece.org/fileadmin/DAM/commission/MDGs/MDG_Report_final.pdf Accessed December 27, 2012.

Gwatkin, Davidson R. Who Would Gain most from Efforts to Reach the Millennium Development Goals for Health? Health, Nutrition and Population (HNP) Discussion Paper. Washington, DC: The International Bank for Reconstruction and Development / The World Bank, 2002.

Herfkens, Eveline and Mandeep Bains. "Reaching our Development Goals - Why does Aid Effectiveness Matter." n.d. OECD. www.oecd.org/dataoecd/43/31/40987004.pdf Accessed December 27, 2012.

Holland, Paul W. Statistics and Causal Inference, Journal of the American Statistical Association, Vol. 81, No.396. (Dec., 1986), pp. 945–960. http://www.jstor.org/stable/2289064 Accessed December 27, 2012.

HuRiLINK. Localizing the MDGs for Effective Integrated Local Development - An Overview of Practices and Lessons Learned. http://www.hurilink.org/tools/Localizing_the_MDGs.pdf Accessed 12 October 2012

Leo, Benjamin and Thuotte Ross. "MDG Progress Index 2011: The Good (Country Progress), the Bad (Slippage) and the Ugly (Fickle Data)." 2011.

Littlefield, Elizabeth, Jonathan Murduch and Syed Hashemi. "Is Microfinance an Effective Strategy to Reach the Millennium Development Goals?" 2003. http://ifmr.ac.in/cmf/wp-content/uploads/2007/06/mf-MDGs-morduch.pdf Accessed December 27, 2012.

Lozano, Rafael and et. al. "Progress towards Millennium Development Goals 4 and 5 on maternal and child mortality: an updated systematic analysis." The Lancet Volume 378, Issue 9797 (2011): 1139–1165.

Murray, Christopher JL. "Towards good practice for health statistics: lessons from the Millennium Development Goal health indicators." The Lancet Volume 369, Issue 9564 (2007): 862–873.

Radelet, Steven. Aid Effectiveness and the Millennium Development Goals. Washington DC: Centre for Global Development, 2004.

Rajaratnam, Julie Knoll and et. al. "Neonatal, postneonatal, childhood, and under-5 mortality for 187 countries, 1970—2010: a systematic analysis of progress towards Millennium Development Goal 4." The Lancet, Volume 375, Issue 9730 (2010): 1988 - 2008.

Ram, F, S.K Mohanty and Usha Ram. Progress and Prospects of Millennium Development Goals in India. Mumbai: International Institute for Population Sciences, Mumbai, 2009. http://www.iipsindia.org/pdf/a08mohanty_report.pdf Accessed December 27, 2012.

Sahn, David E and David C Stifel. "Progress Toward the Millennium Development Goals in Africa." World Development (2003): 31-1: 23–52.

Scîntee, Silvia Gabriela and Adriana Galan. Public Health Strategies: A Tool for Regional Development. Hans Jacobs Publishing Company, 2005.

Sumner, Andrew and Thomas Lawo. "MDGs and Beyond - Pro-Poor Policy in a Changing World." EADI (2010).

UNDP. "Beyond the Midpoint: Achieving the Millennium Development Goals." 2010.

United Nations Website http://www.un.org/millenniumgoals/bkgd.shtml Accessed December 27, 2012.

United Nations General Assembly, “We the peoples: the role of the United Nations in the twenty-first century”, 27 March 2000, http://unpan1.un.org/intradoc/groups/public/documents/un/unpan000923.pdf Accessed December 27, 2012.

UNFPA, Financial Resource Flows for Population Activities in 2009, 2011, https://www.unfpa.org/public/global/publications/pid/3292 Accessed December 28, 2012.

World Bank. "Global Monitoring Report - MDGs after the Crisis." (2010).

You, Danzhen, et al. "Levels and Trends in Under-Five Mortality, 1990-2008." The Lancet, Vol 375, Issue 9709 (2009): 100-103.