Text-mining IMF country reports - an original dataset

Mihalyi, David and Mate, Akos (2019): Text-mining IMF country reports - an original dataset.

Abstract

This article introduces an original panel dataset based on the text of country reports by the International Monetary Fund. It consists of a total of 5561 Article IV consultation and program review documents, published between 2004 and 2018 on 201 countries. The text of these reports provide indications of the perceived policy weaknesses, economic risks, ongoing reforms and implemented or neglected policy advice. Thus the content of IMF reports are widely used in the economics, political science and IR literature. To our knowledge this is the first comprehensive dataset that aggregates these country reports.

The paper gives a detailed account on the data acquisition and management process. To demonstrate and validate the dataset’s application for research we present three validation exercises. We find that Article IV reports can indicate incoming institutional reforms, show changes in IMF policy advice overtime and identify potential gains from recently discovered natural resources in certain cases. Taken together, this paper contributes an original dataset of IMF country reports and demonstrates how it can be a useful foundation for further research into the role of international financial institutions.

• Item Type: MPRA Paper
• Language: English
• Keywords: economic policy, IMF, text analysis, original dataset
• Subjects: E - Macroeconomics and Monetary Economics > E6 - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook > E60 - General; F - International Economics > F5 - International Relations, National Security, and International Political Economy > F53 - International Agreements and Observance ; International Organizations

References

Apel, M. and M. Grimaldi (2012). The information content of central bank minutes.

Baker, S. R., N. Bloom, and S. J. Davis (2016). Measuring economic policy uncertainty.The Quarterly Journal of Economics 131(4), 1593–1636.

Beaudry, P. and T. Willems (2018). On the macroeconomic consequences of over-optimism. Technical report,National Bureau of Economic Research.

Bennani, H. and M. Neuenkirch (2017). The (home) bias of European central bankers: New evidence based on speeches.Applied Economics 49(11), 1114–1131.

Benoit, K. (2018).Quanteda: Quantitative Analysis of Textual Data. R package version 1.3.4.

Blanchard, O. J. and D. Leigh (2013). Growth forecast errors and fiscal multipliers.American Economic Review 103(3), 117–20.

Broome, A. (2015). Back to basics: the great recession and the narrowing of IMF policy advice.Gover-nance 28(2), 147–165.

Choi, H. and H. Varian (2009). Predicting initial claims for unemployment benefits.Google Inc, 1–5.

Dhar, S. (2014). IMF Macroeconomic Policy Advice in the Financial Crisis Aftermath. IEO BackgroundPaper No. BP/14/07 (Washington: International Monetary Fund).

Dreher, A. (2006). IMF and economic growth: The effects of programs, loans, and compliance with condi-tionality.World Development 34(5), 769–788.

Dreher, A., J.-E. Sturm, and J. R. Vreeland (2015). Politics and IMF conditionality.Journal of Conflict Resolution 59(1), 120–148.

Edwards, M. S., K. A. Coolidge, and D. A. Preston (2011). Who Reveals? Transparency and the IMF’s Article IV Consultations.

Gallagher, K. P. and Y. Tian (2017). Regulating capital flows in emerging markets: the IMF and the global financial crisis. Review of development finance 7(2), 95–106.

Gehring, K. and V. Lang (2018). Stigma or Cushion? IMF Programs and Sovereign Creditworthiness.

Gentzkow, M., B. T. Kelly, and M. Taddy (2017). Text as data.

Grimmer, J. and B. M. Stewart (2013). Text as data: The promise and pitfalls of automatic content analysis methods for political texts.Political analysis 21(3), 267–297.IMF (2014).

2014 Triennial Surveillance Review - Staff Background Studies.International Monetary Fund Policy Papers.

Kenny, C. and M. O’Donnell. Do the results match the rhetoric? an examination of world bank gender projects. CGD Policy Paper 77.

Kentikelenis, A. E., T. H. Stubbs, and L. P. King (2016). IMF conditionality and development policy space,1985–2014. Review of International Political Economy 23(4), 543–582.

Laver, M., K. Benoit, and J. Garry (2003). Extracting policy positions from political texts using words as data.American Political Science Review 97(2), 311–331.

Laver, M. and J. Garry (2000). Estimating policy positions from political texts.American Journal of Political Science, 619–634.

Lombardi, D. and N. Woods (2008). The politics of influence: An analysis of IMF surveillance.Review of International Political Economy 15(5), 711–739.

Lowe, W. (2008). Understanding word scores.Political Analysis 16(4), 356–371.

Lucca, D. O. and F. Trebbi (2009). Measuring central bank communication: An automated approach with application to FOMC statements. Technical report, National Bureau of Economic Research.

Mussa, M. and M. Savastano (1999). The IMF approach to economic stabilization.NBER macroeconomicsannual 14, 79–122.

Ortiz, I., M. Cummins, J. Capaldo, and K. Karunanethy (2015). The decade of adjustment: A review of austerity trends 2010-2020 in 187 countries.

Rodrik, D. (2006). Goodbye Washington consensus, hello Washington confusion? A review of the World Bank’s economic growth in the 1990s: Learning from a decade of reform. Journal of Economic literature 44(4), 973–987.

Roy, R. and R. Almeida Ramos (2012). IMF Article IV reports: An analysis of policy recommendations.Technical report, Working Paper, International Policy Centre for Inclusive Growth.

Sands, P., A. El Turabi, P. A. Saynisch, and V. J. Dzau (2016). Assessment of economic vulnerability to infectious disease crises.The Lancet 388(10058), 2443–2448.Shin, Y. and M. R.

Glennerster (2003).Is Transparency Good for You, and Can the IMF Help?Number3-132. International Monetary Fund.

Tetlock, P. C. (2007). Giving content to investor sentiment: The role of media in the stock market.The Journal of finance 62(3), 1139–1168