Does the Journal Impact Factor help make a Good Indicator of Academic Performance?

Mishra, SK (2009): Does the Journal Impact Factor help make a Good Indicator of Academic Performance?

Abstract

After the notification of the University Grants Commission (Minimum Qualifications for Appointment of Teachers and other Academic Staff in Universities and Colleges and Measures for the Maintenance of Standards in Higher Education) Regulations, 2009 on September 23rd 2009, publication of research papers/articles in reputed journals has become an important factor in assessment of the academic performance of teachers in colleges and universities in India. One of the measures of reputation and academic standard (rank or importance) of a journal is the so-called ‘Impact Factor.’ This study makes a detailed statistical analysis of Journal Impact Factors across the disciplines. It finds that if journal impact factor is used to assess the academic performance of individuals (for the purpose of selection, promotion, etc) and it is not borne in mind that due to vast differences in the nature of distribution of impact factors across the disciplines they are not justifiably comparable, a below average scholar in the one discipline will rank higher and will be honored (and benefitted) more than another scholar in some other discipline (wherein the journal impact factor is adversely skew). It may be noted that in the university departments there are specializations with low impact factor journals and other specializations with very high impact factor journals. But the teachers/researchers of different specializations in the departments compete with each other for promotion. Whether the researchers with an unfortunate specialization (wherein the journal impact factor is adversely skewed) receive justice on such criteria remains an open question.

• Item Type: MPRA Paper
• Language: English
• Keywords: Journal impact factor; University Grants Commission; regulation; India; UGC; Higher education; academic performance indicator; API; skewness
• Subjects: A - General Economics and Teaching > A2 - Economic Education and Teaching of Economics > A23 - Graduate; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I23 - Higher Education ; Research Institutions; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I28 - Government Policy; M - Business Administration and Business Economics ; Marketing ; Accounting ; Personnel Economics > M5 - Personnel Economics > M51 - Firm Employment Decisions ; Promotions

References

1. Hemmingsson, A., Mygind ,T. , Skjennald, A. and Johan, Edgren, J. (2002) “Manipulation of Impact Factors by Editors of Scientific Journals”, American Journal of Roentgenology; 178: 767. http://www.ajronline.org/cgi/content/full/178/3/767

2. Seglen PO (1997). "Why the impact factor of journals should not be used for evaluating research". BMJ 314 (7079): 498–502. http://www.pubmedcentral.nih.gov/picrender.fcgi?artid=2126010&blobtype=pdf

3. "Not-so-deep impact". Nature 435 (7045): 1003–4. 2005. doi:10.1038/4351003a. PMID 15973362.

4. "House of Commons - Science and Technology - Tenth Report". 2004-07-07 http://www.publications.parliament.uk/pa/cm200304/cmselect/cmsctech/399/39912.htm

5. Oh, H.C. and Lim, J.F.Y. (2009) “Is the journal impact factor a valid indicator of scientific value?”, Singapore Med. Journal, 50(8): 749-751.

6. Luyt, B. (2009) “The Political Economy of the Journal Impact Factor”, http://www.cais-acsi.ca/proceedings/2009/Luyt_2009.pdf

7. Russell, R. and Singh, D. (2009) “Impact factor and its role in academic promotion”, International Journal of COPD. 4: 265-66 http://www.dovepress.com/impact-factor-and-its-role-in-academic-promotion-peer-reviewed-article