Mishra, SK (2008): On the optimality of academic rankings of regions with RePEc data.

PDF
MPRA_paper_11098.pdf Download (623kB)  Preview 
Abstract
Based on the bibliographical data available with the RePEc (Research Papers in Economics), the Internet Documents in Economics Access Service (IDEAS) publishes every month the updated academic rankings of different geographic regions (countries/states in the US). This paper raises the question whether the method used by the IDEAS/RePEc to obtain academic rankings of different regions in terms of the academic performance of economists associated with them can be considered optimal. It devises five different types of ranking procedure based on the principles of representation of numerically large and varied types of ranking criteria by a single index of overall ranking scores. Empirically, it uses the data published by the IDEAS for the month of September 2008.
It is found that the overall ranking scores obtained by the IDEAS are almost optimal on the four (of the five) principles of representation. However, it is not so when the principle of representation is maximization of the minimal squared correlation of overall ranking scores with the constituent individual ranking scores. The overall ranking scores based on maximization of minimal squared correlation beget larger impact (weight) of a select few scientometric criteria such as hindex, download counts, and certain specific (coauthorship discounted) measures of impactweighted citation and productivity of authors affiliated to the regions under consideration. As a consequence, it has some bias in favour of economically developed regions, while the overall ranking scores obtained by the IDEAS are slightly biased in favour of the economically less developed regions. The IDEAS rankings, therefore, have a tendency to discount for the disadvantages faced by the economists associated with the less privileged regions.
Item Type:  MPRA Paper 

Original Title:  On the optimality of academic rankings of regions with RePEc data 
Language:  English 
Keywords:  IDEAS; RePEc; Bibliometric; Scientometric; principles of representation; academic rankings; economics; impact factors; hindex; citation index; journal pages; global optimality; differential evolution; Principal Components Analysis 
Subjects:  C  Mathematical and Quantitative Methods > C4  Econometric and Statistical Methods: Special Topics > C43  Index Numbers and Aggregation C  Mathematical and Quantitative Methods > C6  Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C63  Computational Techniques ; Simulation Modeling C  Mathematical and Quantitative Methods > C6  Mathematical Methods ; Programming Models ; Mathematical and Simulation Modeling > C61  Optimization Techniques ; Programming Models ; Dynamic Analysis J  Labor and Demographic Economics > J2  Demand and Supply of Labor > J24  Human Capital ; Skills ; Occupational Choice ; Labor Productivity A  General Economics and Teaching > A1  General Economics > A14  Sociology of Economics 
Item ID:  11098 
Depositing User:  Sudhanshu Kumar Mishra 
Date Deposited:  14 Oct 2008 13:54 
Last Modified:  23 Aug 2016 12:19 
References:  Hirsch, J. E. (2005) "An Index to Quantify an Individual's Scientific Research Output", Proceedings of the National Academy of Sciences, 102 (46): 16569–16572. Kendall, M.G. and Stuart, A. (1968) The Advanced Theory of Statistics, vol. 3, Charles Griffin & Co., London. Mishra, S. K. (2006) “Global Optimization by Differential Evolution and Particle Swarm Methods: Evaluation on Some Benchmark Functions”, SSRN: http://ssrn.com/abstract=933827 Mishra, S.K. (2008)”What Determines the Academic and Professional Participation of Economists?”, SSRN: http://ssrn.com/abstract=1265044. Storn, R. and Price, K. (1995) ”Differential Evolution  A Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces”, Technical Report, International Computer Science Institute, Berkley. Tol, R.S.J. (2008) “A Rational, Successive GIndex applied to Economics Departments in Ireland”, Journal of Informetrics, 2: 149155. Zimmermann, C. (2007) “Academic Rankings with RePEc”, Working Papers Series #200736, Dept. of Economics, Univ. of Connecticut: http://www.econ.uconn.edu/working/200736.pdf 
URI:  https://mpra.ub.unimuenchen.de/id/eprint/11098 