On the optimality of academic rankings of regions with RePEc data

Mishra, SK (2008): On the optimality of academic rankings of regions with RePEc data.

Abstract

Based on the bibliographical data available with the RePEc (Research Papers in Economics), the Internet Documents in Economics Access Service (IDEAS) publishes every month the up-dated academic rankings of different geographic regions (countries/states in the US). This paper raises the question whether the method used by the IDEAS/RePEc to obtain academic rankings of different regions in terms of the academic performance of economists associated with them can be considered optimal. It devises five different types of ranking procedure based on the principles of representation of numerically large and varied types of ranking criteria by a single index of overall ranking scores. Empirically, it uses the data published by the IDEAS for the month of September 2008.

It is found that the overall ranking scores obtained by the IDEAS are almost optimal on the four (of the five) principles of representation. However, it is not so when the principle of representation is maximization of the minimal squared correlation of overall ranking scores with the constituent individual ranking scores. The overall ranking scores based on maximization of minimal squared correlation beget larger impact (weight) of a select few scientometric criteria such as h-index, download counts, and certain specific (co-authorship discounted) measures of impact-weighted citation and productivity of authors affiliated to the regions under consideration. As a consequence, it has some bias in favour of economically developed regions, while the overall ranking scores obtained by the IDEAS are slightly biased in favour of the economically less developed regions. The IDEAS rankings, therefore, have a tendency to discount for the disadvantages faced by the economists associated with the less privileged regions.

• Item Type: MPRA Paper
• Language: English
• Keywords: IDEAS; RePEc; Bibliometric; Scientometric; principles of representation; academic rankings; economics; impact factors; h-index; citation index; journal pages; global optimality; differential evolution; Principal Components Analysis
• Subjects: C - Mathematical and Quantitative Methods > C4 - Econometric and Statistical Methods: Special Topics > C43 - Index Numbers and Aggregation; C - Mathematical and Quantitative Methods > C6 - Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C63 - Computational Techniques ; Simulation Modeling; C - Mathematical and Quantitative Methods > C6 - Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C61 - Optimization Techniques ; Programming Models ; Dynamic Analysis; J - Labor and Demographic Economics > J2 - Demand and Supply of Labor > J24 - Human Capital ; Skills ; Occupational Choice ; Labor Productivity; A - General Economics and Teaching > A1 - General Economics > A14 - Sociology of Economics

References

Hirsch, J. E. (2005) "An Index to Quantify an Individual's Scientific Research Output", Proceedings of the National Academy of Sciences, 102 (46): 16569–16572.

Kendall, M.G. and Stuart, A. (1968) The Advanced Theory of Statistics, vol. 3, Charles Griffin & Co., London.

Mishra, S. K. (2006) “Global Optimization by Differential Evolution and Particle Swarm Methods: Evaluation on Some Benchmark Functions”, SSRN: http://ssrn.com/abstract=933827

Mishra, S.K. (2008)”What Determines the Academic and Professional Participation of Economists?”, SSRN: http://ssrn.com/abstract=1265044.

Storn, R. and Price, K. (1995) ”Differential Evolution - A Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces”, Technical Report, International Computer Science Institute, Berkley.

Tol, R.S.J. (2008) “A Rational, Successive G-Index applied to Economics Departments in Ireland”, Journal of Informetrics, 2: 149-155.

Zimmermann, C. (2007) “Academic Rankings with RePEc”, Working Papers Series #2007-36, Dept. of Economics, Univ. of Connecticut: http://www.econ.uconn.edu/working/2007-36.pdf