Research Evaluation, Bibliometric Indicators and Impact on Knowledge Development

Fernandes, Graca and Margarida, Lopes (2017): Research Evaluation, Bibliometric Indicators and Impact on Knowledge Development. Published in: The IUP Journal of Knowledge Management , Vol. VOL XV, No. nº1, 2018 (January 2018)

Abstract

With increased globalization and international competition among research centers and universities, bibliometrics regained a new élan. As a matter of fact it became the most important criteria – sometimes the only one - used for the evaluation of scientific papers and thereby for the faculty’s classification and progression in the academic and research careers. Accreditation procedures and the building of international rankings reinforced this trend as well as the major role played by reference repertoires. This self-feeding and circular process deserves a deeper insight mostly because it generates important knowledge waste. This is so because non-English speaking scientific communities usually face meaningful obstacles to access to the abovementioned repertoires. And accordingly, their scientific papers risk becoming unknown or underutilized even though they develop matters and topics which are relevant for their authors’ societies. At the same time, progression in academic or research careers go in parallel with the reproduction and transmission of official knowledge and generally neglect alternative thinking. In this paper we shed light on these issues. After a brief literature review, we analyze the situation of a Portuguese higher education research institution under both a quantitative and a qualitative analysis which results confirm the above referred main trends.

• Item Type: MPRA Paper
• Language: English
• Keywords: Key Words: bibliometrics; accreditation repertoires; academic and research careers; waste of knowledge.
• Subjects: I - Health, Education, and Welfare > I2 - Education and Research Institutions > I23 - Higher Education ; Research Institutions; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I25 - Education and Economic Development

References

- Altbach Ph G (2015), “The Tyranny of Citations”, International Higher Education, e-journal (http://ejournals.bc.edu/ojs/index.php/ihe/article/viewFile/7889/7040).

- Anninos L (2013), “Research performance evaluation: some critical thoughts on standard bibliometric indicators”, Studies in Higher Education, volume 39-2014,Nº9 (http://www.tandfonline.com/doi/full/10.1080/03075079.2013.801429?scroll=top&needAccess=true).

- Apple M W (2014), Official Knowledge - Democratic Education in a Conservative Age, 3rd. edition, Routledge, New York & London.

- 2nd. Author (2016), “The Dynamics of Knowledge in Portugal – the role played by public institutions”, University Library of Munich: MPRA Paper 80171.

- Beigel F (2014), “Publishing from the periphery: Structural heterogeneity and segmented circuits. The evaluation of scientific publications for tenure in Argentina’s CONICET”, Current Sociology, Vol. 62(5), 743-765 (http://journals.sagepub.com/doi/pdf/10.1177/0011392114533977).

- Bertocchi G, Gambardella A, Jappelli T, Nappi C and Peracchi F (2013), “Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy”, IZA DP Nº 7739 (http://ftp.iza.org/dp7739.pdf).

- Bornmann L and Leyedesdorff L (2014), “Scientometrics in a changing science landscape”, Science and Society. EMBO reports (2014) 15, pp. 1228-1232 (http://embor.embopress.org/content/15/12/1228).

- Bornmann L , Stefaner M , de Moya Anegón F and Mutz R (2014), “Ranking and mapping of universities and research-focused institutions worldwide based on highly-cited papers: A visualisation of results from multi-level models”, Online Information Review, Vol. 38, Nº 1, pp.43 – 58.

- Chavarro D A, Tang P and Rafols I (2017), “Why Researchers Publish in Non-Mainstream Journals: Training, Knowledge Bridging, and Gap Filling”, Research Policy, Vol. 46, Nº 9, pp. 1666-1680.

- Mingers J and Willmott H (2012), “Taylorizing business school research: On the ‘one best way’ performative effects of journal ranking lists”, The Tavistock Institute, Human Relations, Vol. 66, Nº 8, pp. 1051-1073 (http://journals.sagepub.com/doi/pdf/10.1177/0018726712467048).

- Zanon B (2012), “Research quality assessment and planning journals. The Italian perspective”, Università degli Studi di Trento (http://www.ijpp.it/index.php/it/article/view/22