Ordinal ranking aggregation in bibliometric analysis

Wohlrabe, Klaus and Friedrich, Elisabeth (2016): Ordinal ranking aggregation in bibliometric analysis.

Abstract

This paper reviews standard ranking aggregation approaches in bibliometric analysis. These include the arithmetic and the harmonic mean. We also present two less-well known aggregation schemes, lexicographic and graphicolexic, which are based on the order of the rankings. Finally, we introduce two recently proposed ranking aggregation approaches which are based on stochastic aggregation. We describe all approaches and give a small illustrative and an empirical example to highlight the differences.

• Item Type: MPRA Paper
• Language: English
• Keywords: ranking aggregation, stochastic aggregation, RePEc
• Subjects: A - General Economics and Teaching > A1 - General Economics > A12 - Relation of Economics to Other Disciplines; A - General Economics and Teaching > A1 - General Economics > A14 - Sociology of Economics

References

Ben-David D (2010) Ranking Israel’s economists. Scientometrics 82(2):351–364.

Cook WD, Raviv T, Richardson AJ (2010) Aggregating incomplete lists of journal rankings: An application to academic accounting journals. Accounting perspectives 9(3):217–235.

Franses PH (2014) Trends in three decades of rankings of dutch economists. Scientometrics 98(2):1257–1268.

Harzing A, van der Wal R (2009) A Google Scholar h-index for journals: An alternative metric to measure journal impact in economics and business. Journal of the American Society for Information Science and Technology 60(1):41–46.

Marginson S (2014) University rankings and social science. European Journal of Education 49(1):45–59

Pihur V, Datta S, Datta S (2009) Rankaggreg, an r package for weighted rank aggregation. BMC bioinformatics 10(1):62.

Sculley D (2007) Rank aggregation for similar items. In: SDM, SIAM, pp 587–592.

Seiler C, Wohlrabe K (2012) Ranking economists on the basis of many indicators: An alternative approach using repec data. Journal of Informetrics 6(2):389–402.

Wohlrabe K (2016) Taking the temperature: A meta-ranking of economics journals. CESifo Working Paper 5726.

Zimmermann C (2013) Academic Rankings with RePEc. Econometrics 1(3):249–280.