Mind the Gap: Analyzing the impact of data gap in Millennium Development Goals’ (MDGs) indicators on the progress towards MDGs

Jacob, Arun (2016): Mind the Gap: Analyzing the impact of data gap in Millennium Development Goals’ (MDGs) indicators on the progress towards MDGs.

Abstract

This paper analyses the impact of data gap in Millennium Development Goals (MDGs) performance indicators on actual performance success of MDGs. Performance success, within the MDG framework, is quantified using six different ways proposed in the existing literature, including both absolute and relative performance and deviation from historical transition paths of MDG indicators. The empirical analysis clearly shows that the data gap in performance measurement is a significant predictor of poor MDG performance in terms of any of the six progress measures. Larger the data gap or weaker the performance measurement system, lesser is the probability of MDG performance success. The empirical methodology used in the paper combines a Heckman correction and instrumental variable estimation strategies to simultaneously account for potential endogeneity of the key data gap variable and bias due to sample selection. This result holds true even after controlling for overall national statistical capacity and a variety of socioeconomic factors. The paper underlines the need to strengthen the performance measurement system attached to the 2030 Agenda for Sustainable Development and the associated Sustainable Development Goals (SDGs). This paper is the first attempt at empirically evaluating the value of data in the context of international development goals and gives empirical evidence for the need to harness the ‘data revolution’ for sustainable development.

• Item Type: MPRA Paper
• Language: English
• Keywords: Millennium Development Goals (MDGs); the 2030 Agenda for Sustainable Development; Sustainable Development Goals; performance indicators; performance measurement; value of data
• Subjects: F - International Economics > F0 - General > F02 - International Economic Order and Integration; F - International Economics > F6 - Economic Impacts of Globalization > F63 - Economic Development; H - Public Economics > H4 - Publicly Provided Goods > H43 - Project Evaluation ; Social Discount Rate; H - Public Economics > H5 - National Government Expenditures and Related Policies > H53 - Government Expenditures and Welfare Programs; O - Economic Development, Innovation, Technological Change, and Growth > O1 - Economic Development > O15 - Human Resources ; Human Development ; Income Distribution ; Migration; O - Economic Development, Innovation, Technological Change, and Growth > O1 - Economic Development > O19 - International Linkages to Development ; Role of International Organizations; P - Economic Systems > P3 - Socialist Institutions and Their Transitions > P35 - Public Economics; P - Economic Systems > P4 - Other Economic Systems > P47 - Performance and Prospects; Z - Other Special Topics > Z1 - Cultural Economics ; Economic Sociology ; Economic Anthropology > Z18 - Public Policy

References

C. AbouZahr, S. Adjei, and C. Kanchanachitra. From data to policy: good practices and cautionary tales. Lancet, 369(9566):1039–1046, March 2007.

Sabina Alkire and Emma Samman. Mobilising the household data required to progress toward the sdgs. OPHI WORKING PAPER, (72), September 2014.

Jean-Louis Arcand. The (lack of) impact of impact: Why impact evaluations seldom lead to evidence-based policymaking. Revue dŠéconomie du développement, 22:289–311, 2014.

Ernest Aryeetey, Daniel Esty, Edwin Feulner, Thierry Geiger, Daniel Kaufmann, Andreas Kraemer, Marc Levy, John W. McArthur, Robert Steele, Anand Sudarshan, and others. Getting to Zero: finishing the job the MDGs started. In Global Agenda Council, World Economic Forum, April, 2012.

Robert D. Behn. Why Measure Performance? Different Purposes Require Different Measures. Public Administration Review, 63(5):586–606, September 2003. ISSN 1540-6210. doi: 10.1111/1540-6210.00322.

Megan Cassidy. Assessing gaps in indicator availability and coverage. Sdsn report, SDSN, June 2014.

Ken S. Cavalluzzo and Christopher D. Ittner. Implementing performance measurement innovations: evidence from government. Accounting, Organizations and Society, 29(3â˘A ¸S4): 243–267, April 2004. ISSN 0361-3682. doi: 10.1016/S0361-3682(03)00013-8.

Ha-Joon Chang. Comments on jeffrey sachsŠ proposals for a bretton woods 2. The Guardian, October 2008. URL http://www.theguardian.com/commentisfree/2008/oct/22/ economy-economics.

Shuang Chen, Fonteneau Francois, Jutting Johannes, and Stephan Klasen. Towards a post-2015 framework that counts: Development national statistical capacity. Paris21 Discussion Paper, (1), November 2013. URL http://mortenjerven.com/wp-content/uploads/2013/ 04/Panel-8-Jutting.pdf.

Michael A. Clemens, Charles J. Kenny, and Todd J. Moss. The Trouble with the MDGs: Confronting Expectations of Aid and Development Success. World Development, 35(5):735– 751, May 2007. ISSN 0305-750X. doi: 10.1016/j.worlddev.2006.08.003. URL http: //www.sciencedirect.com/science/article/pii/S0305750X07000095.

UN DESA. Inequality matters. Report of the World Social Situation 2013 ST/ESA/345, United Nations Department of Economic and Social Affairs, 2013. URL http://www.un.org/esa/ socdev/documents/reports/InequalityMatters.pdf.

William Easterly. How the millennium development goals are unfair to Africa. World Development, 37(1):26–35, 2009. URL http://www.sciencedirect.com/science/article/ pii/S0305750X08001022.

Sakiko Fukuda-Parr, Joshua Greenstein, and David Stewart. How should mdg success and failurebe judged: Faster progress or achieving the targets? World Development, 41:19–30, January 2013. URL http://www.econstor.eu/handle/10419/71808.

Varun Gauri. MDGs that Nudge: The Millennium Development Goals, Popular Mobilization, and the Post-2015 Development Framework. SSRN Scholarly Paper ID 2183583, Social Science Research Network, Rochester, NY, November 2012. URL http://papers.ssrn.com/ abstract=2183583.

Arie Halachmi. Mandated performance measurement: A help or a hindrance? National Productivity Review, 18(2):59–67, March 1999. ISSN 1520-6734. doi: 10. 1002/npr.4040180211. URL http://onlinelibrary.wiley.com/doi/10.1002/ npr.4040180211/abstract.

Harry P. Hatry. Performance Measurement: Getting Results. Urban Institute, Washington, D.C, 2007.

Brian W. Head. Three lenses of evidence-based policy. The Australian Journal of Public Administration, 67(1):1–11, March 2008.

James J. Heckman. The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement, 4(5):475–92, 1976.

IEAG. The world that counts. Technical report, The United Nations Secretary-GeneralŠs Independent Expert Advisory Group on a Data Revolution for Sustainable Development, November 2014. URL http://www.undatarevolution.org/wp-content/uploads/2014/11/ A-World-That-Counts.pdf.

IFPRI. Agriculture and achieving the millennium development goals. Technical Report 32729- GLB, International Food Policy Research Institute (IFPRI), 2006. URL http://ebrary. ifpri.org/cdm/ref/collection/p15738coll2/id/125143.

Patria de Lancer Julnes and Marc Holzer. Promoting the Utilization of Performance Measures in Public Organizations: An Empirical Study of Factors Affecting Adoption and Implementation. Public Administration Review, 61(6):693–708, November 2001. ISSN 1540-6210. doi: 10.1111/0033-3352.00140. URL http://onlinelibrary.wiley.com/doi/10.1111/ 0033-3352.00140/abstract.

Jonathan Karver, Charles Kenny, and Andy Sumner. MDGS 2.0: What Goals, Targets, and Timeframe? IDS Working Papers, 2012(398):1–57, July 2012. ISSN 2040-0209. doi: 10.1111/j.2040-0209.2012.00398.x. URL http://onlinelibrary.wiley.com/doi/ 10.1111/j.2040-0209.2012.00398.x/abstract.

Stephan Klasen and Simon Lange. Getting progress right: Measuring progress towards the mdgs against historical trends. Courant Research Centre, (87), August 2011. URL http: //www2.vwl.wiso.uni-goettingen.de/courant-papers/CRC-PEG_DP_87.pdf.

K. Lahiri and P. Schmidt. On the estimation of triangular structural systems. Econometrica, 46: 1217˝U1221, 1978.

Benjamin Leo. Who are the MDG trailblazers? A new MDG progress index. Center for Global Development Working Paper, (222), 2010. URL http://papers.ssrn.com/sol3/papers. cfm?abstract_id=1694138.

Marta Lomazzi, Bettina Borisch, and Ulrich Laaser. The Millennium Development Goals: experiences, achievements and what’s next. Global Health Action, 7, February 2014. ISSN 1654-9716. doi: 10.3402/gha.v7.23695. URL http://www.ncbi.nlm.nih.gov/pmc/ articles/PMC3926985/.

Richard Manning. Using indicators to encourgae development: Lessons from the millennium development goals. Technical Report 2009:01, DIIS Reports / Danish Institute for International Studies, 2009. URL http://www.econstor.eu/handle/10419/59842.

Richard Manning. The Impact and Design of the MDGs: Some Reflections. IDS Bulletin, 41(1):7–14, January 2010. ISSN 1759-5436. doi: 10.1111/j.1759-5436.2010.00098. x. URL http://onlinelibrary.wiley.com/doi/10.1111/j.1759-5436.2010. 00098.x/abstract.

Claire Melamed and Andy Sumner. A Post-2015 Global Development Agreement: why, what, who? Cairo, October 2011. ODI. URL http://www.odi.org/sites/odi.org.uk/ files/odi-assets/publications-opinion-files/7369.pdf.

Juan Muro, Cristina Suarez, and Maria del Mar Zamora. Computing murphy˝Utopel-corrected variances in a heckprobit model with endogeneity. The Stata Journal, 10(2):252˝U258, 2010. URL http://www.stata-journal.com/sjpdf.html?articlenum=st0191.

K. M. Murphy and R. H. Topel. Estimation and inference in two-step econometric models. Journal of Business and Economic Statistics, 20:88–97, 2002.

Kathryn E. Newcomer. Using performance measurement to improve programs. New Directions for Evaluation, 1997(75):5–14, September 1997. ISSN 1534-875X. doi: 10.1002/ev.1076. URL http://onlinelibrary.wiley.com/doi/10.1002/ev.1076/abstract.

ODI. Millennium Development Goals Report Card: Measuring Progress Across Countries.Technical report, Overseas Development Institute, London, 2010. URL http://www.odi. org/sites/odi.org.uk/files/odi-assets/publications-opinion-files/ 6172.pdf.

PARIS21. The road map for a country-led data revolution. Technical report, Secretariat of the Partnership in Statistics for Development in the 21st Century (PARIS21), 2015. URL http://datarevolution.paris21.org/sites/default/files/Road_ map_for_a_Country_led_Data_Revolution_web.pdf.

Nana K. Poku and Jim Whitman. The Millennium Development Goals and Development after 2015. Third World Quarterly, 32(1):181–198, February 2011. ISSN 0143-6597. doi: 10. 1080/01436597.2011.543823. URL http://dx.doi.org/10.1080/01436597.2011. 543823.

Espen Beer Prydz. Knowing in time : How technology innovations in statistical data collection can make a difference in development. PARIS21 Discussion Paper, (2), January 2014. URL http://www.paris21.org/sites/default/files/ PARIS21-DiscussionPaper2-Knowing.pdf.

Dimitri Sanga. The challenges of monitoring and reporting on the millennium development goals in africa by 2015 and beyond. Journal statistique africain, (12), May 2011.

Mary Bryna Sanger. Does Measuring Performance Lead to Better Performance? Journal of Policy Analysis and Management, 32(1):185–203, January 2013. ISSN 1520-6688. doi: 10.1002/pam.21657. URL http://onlinelibrary.wiley.com/doi/10.1002/pam. 21657/abstract.

Kim Schildkamp, Melanie Ehren, and Mei Kuin Lai. Editorial article for the special issue on databased decision making around the world: from policy to practice to results. School Effectiveness and School Improvement, 23(2):123–131, June 2012.

SDSN. Data for development: A needs assessment for sdg monitoring and statistical capacity development. Technical report, Sustainable Development Solutions Network (SDSN), April 2015. URL http://unsdsn.org/wp-content/uploads/2015/04/ Data-for-Development-Full-Report.pdf.

James P. Spillane. Data in practice: Conceptualizing the data-based decision-making phenomena. American Journal of Education, 118(2):113–141, 2012.

Elizabeth Stuart, Emma Samman, William Avis, and Tom Berliner. The data revolution : Finding the missing millions. ODI Research Report 3, Overseas Development Institute (ODI), 203 Blackfriars Road London SE1 8NJ, April 2015.

Jeannette Taylor. Strengthening the Link Between Performance Measurement and Decision Making. Public Administration, 87(4):853–871, December 2009. ISSN 1467-9299. doi: 10.1111/j.1467-9299.2009.01788.x. URL http://onlinelibrary.wiley.com/doi/ 10.1111/j.1467-9299.2009.01788.x/abstract.

UNDP. Beyond the Midpoint: Achieving the Millennium Development Goals. Technical report, UNDP, 2010. URL http://content.undp.org/go/newsroom/publications/ poverty-reduction/poverty-website/mdgs/beyond-the-midpoint.en.

Jan Vandemoortele. Ambition is golden: Meeting the mdgs. Developmen, 48:5–11, 2005. doi: 10.1057/palgrave.development.1100100. URL http://www.palgrave-journals.com/ development/journal/v48/n1/full/1100100a.html.

Jan Vandemoortele. The MDG Conundrum: Meeting the Targets Without Missing the Point. Development Policy Review, 27(4):355–371, July 2009. ISSN 09506764. doi: 10.1111/ j.1467-7679.2009.00451.x. URL http://doi.wiley.com/10.1111/j.1467-7679. 2009.00451.x.

Jan Vandemoortele. Post-2015 agenda: mission impossible? Development Studies Research, 1 (1):223˝U232, 2014. doi: 10.1080/21665095.2014.943415. URL http://dx.doi.org/ 10.1080/21665095.2014.943415.

Xiaohu Wang. Performance Measurement in Budgeting: A Study of County Governments. Public Budgeting & Finance, 20(3):102–118, January 2000. ISSN 1540-5850. doi: 10.1111/0275-1100.00022. URL http://onlinelibrary.wiley.com/doi/10.1111/ 0275-1100.00022/abstract.

Thomas Weiss, Jolly Richard, and Louis Emmerij. UN Ideas that Changed the World. Indiana University Press., Bloomington, 2009.

Jeffrey M. Wooldridge and Anastasia Semykina. Estimating panel data models in the presence of endogeneity and selection. Journal of Econometrics, (157):375–380, August 2010.

Jeffrey M. Woolridge. Econometric Analysis of Cross Section and Panel Data. The MIT Press, Cambridge, Massachusetts, second edition, 2010.