The Italian Reform of the academic recruitment system: an appraisal of ANVUR and CUN benchmarks for assessing candidates and commissioners

Abatemarco, Antonio and Dell'Anno, Roberto (2012): The Italian Reform of the academic recruitment system: an appraisal of ANVUR and CUN benchmarks for assessing candidates and commissioners.

Abstract

The present study is aimed at contributing to the ongoing debate about the implications of the incoming recruitment system as proposed by Law 240/2010 (Gelmini's reform). For this purpose, the main implications of the two alternative criteria respectively proposed by the National Agency for the Evaluation of the University System and Research (ANVUR) and the National University Council (Consiglio Universitario Nazionale - CUN) are investigated for assessing candidates and commissioners admitted to apply for the national scientific approval of the Italian academic recruitment system. Using the sample of 1327 Italian academic economists (secs p/01, p/02, p/03) enrolled for the academic year 2011-12, the analysis provides two simulations. First, the thresholds for both ANVUR and CUN criteria as well as the resulting shares of "qualified" candidates and commissioners are computed. Second, the impact of the new eligibility criteria on the academic competitions (p01, p02, p03) that occurred in 2005 is simulated under the assumption that behavioral responses are absent. The findings suggest that (i) CUN criteria provide more selective benchmarks than ANVUR ones, and (ii) in the absence of behavioral responses, the new system of recruitment is expected to remarkably affect the profile of the Italian academic system.

• Item Type: MPRA Paper
• Language: English
• Keywords: Academic recruitment system; research assessment; citation-based indices; Italian University Reform
• Subjects: I - Health, Education, and Welfare > I2 - Education and Research Institutions > I28 - Government Policy; H - Public Economics > H5 - National Government Expenditures and Related Policies > H52 - Government Expenditures and Education

References

Abatemarco A. - Dell’Anno R. (2012). Certainty equivalent citation: generalized classes of citation indexes. Scientometrics (DOI 10.1007/s11192-012-0758-x).

ANVUR (2011a), Criteri e parametri di valutazione dei candidati e dei commissari dell'abilitazione nazionale scientifica. Approvato il 22/06/2011 n. 1/2011. (Disponibile da: http://www.anvur.org/media/277/documento01_11.pdf).

ANVUR (2011b), Sul documento ANVUR relativo ai criteri di abilitazione scientifica nazionale, commenti, osservazioni critiche e proposte di soluzione. Approvato il 25/07/2011 n. 2/2011. (Disponibile da: http://www.anvur.org/sites/anvur-miur/files/Documento%2002_11.pdf).

Baccini A. (2010), Valutare la ricerca scientifica. Uso e abuso degli indicatori bibliometrici, Il Mulino, Bologna.

Bar-Ilan J. (2008), Which h-index? A comparison of WoS, Scopus and Google Scholar, in Scientometrics, vol. 74 (2), pp. 257-271.

Batista P.D. - Campiteli, M.G. and Konouchi, O. (2006), Is it possible to compare researchers with different scientific interests?,Scientometrics, 68(1), pp. 179-189.

Becker S.O. Ichino A. - Peri G. (2004), How Large is the Brain Drain from Italy?. Giornale degli Economisti e Annali di Economia, 63 (1), pp.1-32.

Bonavenutra L. (2011), The Role of Frictions on Italian Academic Recruitment System University of Catania, Department of Economics and Quantitative Methods in its series DEMQ Working Paper Series with number 2011/2.

Bornmann L. (2011), Mimicry in science? Scientometrics, vol. 86, pp. 173-177.

Bruno B. (2010), The Economics of co-authorship, MPRA paper, No. 27730.

Burgos A. (2010), Ranking scientists,Rev. Working Paper Series, 2, Departamento de Fundamentos del Análisis Económico, Universidad de Murcia, Spagna.

Caianelli G. - De Felice A. - Lamonarca M. - Zoboli R. (2006), The publications of Italian Economists in Econlit. Quantitative Assessment and Implications for Research Evaluation, in Economia Politica, vol. XXIII (3), pp. 385-423.

Checchi D. (1999), Tenure. An Appraisal of a National Selection Process for Associate Professorship, in Giornale degli economisti e Annali di economia, 58 (2), pp. 137-181.

Bowles S. (2007), La valutazione della ricerca negli Stati Uniti: risultati di un questionario, Rivista Italiana degli Economisti, 12(2), pp. 255-258

CNVSU (2010), Undicesimo Rapporto sullo Stato del Sistema Universitario. Roma

CUN (2011), Criteri, parametri e indicatori per l’abilitazione scientifica nazionale. Sessione n.84 del 24 maggio 2011 (Disponibile da: http://www.cun.it/media/113043/do_2011_05_24_002.pdf).

Durante R. - Labartino G. - Perotti R. (2011), Academic Dynasties: Decentralization and Familism in the Italian Academia, CEPR Discussion Papers 8645.

Egghe L. (2006), An improvement of the h-index: the g-index, ISSI Newsletter vol. 2, pp. 8-9.

Gagliarducci S. – Ichino A. – Peri G., Perotti R. (2005), Lo splendido isolamento dell’universita italiana”, in Oltre il Declino, Boeri T- Faini R. – Ichino A. - Pisauro G. – Scarpa C. editors, Il Mulino. Bologna.

Harzing A.W. (2008), Google Scholar - a new data source for citation analysis (disponibile da: http://www.harzing.com/pop_gs.htm).

Harzing A.W. (2010), The Impact of different data sources and citation metrics, (disponibile da: http://www.harzing.com/data_metrics_comparison.htm).

Harzing A.W. (2011), Publish or Perish 3.1,www.harzing.com/pop.htm.

Hicks D. – Wang J. (2009), Toward a Bibliometric Database for the Social Sciences and Humanities, Available at: http://works.bepress.com/diana_hicks/18.

Hirsch J.E. (2005), An index to quantify an individual’s scientific research output, in Proceedings of the National Academy of Sciences of the United States of America, vol. 102 (46), pp. 16569-16572.

Jin B.H. - Liang L.M. - Rousseau R. - Egghe, L. (2007), The r- and ar-indices: complementing the h-index, Chinese Science Bulletin, vol. 52, pp. 855-863.

Jin B.H. (2006), H-index: an evaluation indicator proposed by scientist, Science Focus1 (1), pp. 8-9.

Katsaros C. – Manolopoulos Y. - Sidiropoulos A. (2006), Generalized h-index for disclosing latent facts in citation networks, Scientometrics, vol. 72 (2), pp. 253-280.

Labbé C. (2010), Ike Antkare, One of the Great Stars in the Scientific Firmament, 22th newsletter of the international society for scientometrics and informatrics, 6(2), pp. 48-52.

Marcuzzo M.C. - Zacchia G. (2007), L'ECONLIT e gli strumenti per la valutazione della ricerca economica in Italia, Rivista Italiana degli Economisti, 12 (2), pp. 277-306.

Marcuzzo M.C. - Zacchia G. (2010), Peso alle citazioni o pesi alla numerosità? La valutazione degli economisti accademici italiani, Politica Economica, 26 (3), pp. 409-40.

Meho L.I. - Yang K. (2007), A new era in citation and bibliometric analyses: Web of Science, Scopus, and Google Scholar, in Journal of the American Society for Information Science and Technology, vol. 58 (13), pp. 2105–2125.

OECD (2011), Economic surveys: Italy, OECD.

Perotti R. (2002a), The Italian University System: Rules vs. Incentives. First Conference on Monitoring Italy, ISAE, Rome.

Perotti R. (2002b), Il Bollettino dei concorsi 1,(http://www.igier.unibocconi.it/perotti).

Perotti R. (2003), Il Bollettino dei concorsi 2,(http://www.igier.unibocconi.it/perotti).

Perotti R. (2004), Il Bollettino dei concorsi 3,(http://www.igier.unibocconi.it/perotti).

Perotti R. (2006), Il Bollettino dei concorsi 4,(http://www.igier.unibocconi.it/perotti).

Perotti R. (2008), L’università truccata, Einaudi, Milano.

Schreiber M. (2008), To share the fame in a fair way, hm modifies h for multi-authored manuscripts, New Journal of Physics, vol. 10 (4), pp. 040201.

Tarantino E. (2006), Troppo o troppo poco? Web of science, Scopus, Google Scholar: tre database a confronto (un caso di studio), in Bollettino AIB, vol. 46 (1/2), pp. 23-32.

Woeginger G.J., (2008), An axiomatic analysis of Egghe's g-index, Journal of Infometrics, 2, pp. 364-368.

Wu Q., (2010), The w-index: A significant improvement of the h-index, Journal of the American Society for Information Science and Technology, 61 (3), pp. 609-614.