Assessment of quality and efficiency in higher education system. Empirical study for the EU countries

Râlea, Ioana-Alexandra and Pintilescu, Carmen (2025): Assessment of quality and efficiency in higher education system. Empirical study for the EU countries. Forthcoming in: 51st EBES Conference Proceedings (2025)

Abstract

High quality and efficient education are fundamental to a country's development. As a result, the continuous assessment of the quality and efficiency of education remains a subject of constant debate. This has led to an increased interest in developing evaluation methods that are as reliable as possible. In this paper, we assess the quality and efficiency of higher education by constructing composite quality and efficiency indices, using various statistical methods for European Union's countries for the year 2022. For the construction of the composite quality index, we considered nine variables, then we used principal component analysis (PCA) to determine the importance of each variable, whereas the weighting method was applied in order to extract the factor loading coefficients of the score matrix. To construct the composite efficiency index, eight variables were analysed and we applied stochastic frontier analysis (SFA), which estimated a production frontier and measured the random inefficiency of production units. Inefficiency scores were obtained for each country and were combined with the outputs considered in the analysis to provide an overview of the efficiency of decision-making units (DMUs). These results were then correlated with the number of universities included in the international top rankings using the Spearman coefficient. Our findings reveal a positive correlation between the two composite indices and the number of universities featured in these rankings for each country analysed. This confirms that the analysed variables provide insight into the quality and efficiency of higher education system in these countries, which could increase the number of universities included in the international rankings.

• Item Type: MPRA Paper
• Language: English
• Keywords: quality, efficiency, higher education, PCA, SFA, composite index
• Subjects: B - History of Economic Thought, Methodology, and Heterodox Approaches > B2 - History of Economic Thought since 1925 > B23 - Econometrics ; Quantitative and Mathematical Studies; C - Mathematical and Quantitative Methods > C4 - Econometric and Statistical Methods: Special Topics > C43 - Index Numbers and Aggregation; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I21 - Analysis of Education; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I23 - Higher Education ; Research Institutions

References

Agasisti, T., Arnaboldi, M. & Azzone, G. Strategic management accounting in universities: the Italian experience. High Educ 55, 1–15 (2008). https://doi.org/10.1007/s10734-006-9032-6

Agasisti, T. and Bonomi, F. (2014) ‘Benchmarking Universities’ Efficiency Indicators in the Presence of Internal Heterogeneity’, Studies in Higher Education, Vol. 39, No. 7, pp. 1237-1255. https://doi.org/10.1080/03075079.2013.801423

Aigner D.J., Lovell C.A.K. and Schmidt P. (1977): Formulation and Estimation of Stochastic Frontier Production Function Models, Journal of Econometrics 6: 21-37.

Battese G.E. and Coelli T.J. (1988): Prediction of Firm-level Technical Inefficiencies with a Generalized Frontier Production Function and Panel Data, Journal of Econometrics 38: 387-399.

Bessent, A. M., & Bessent, E. W. (1980). Determining the Comparative Efficiency of Schools through Data Envelopment Analysis. Educational Administration Quarterly, 16(2), 57-75. https://doi.org/10.1177/0013161X8001600207

Bonaccorsi, Andrea & Daraio, Cinzia & Simar, Léopold. (2006). Advanced Indicators of Productivity of Universities, An Application of Robust Nonparametric Methods to Italian Data. Scientometrics. 66. 389-410. 10.1007/s11192-006-0028-x

Brysland, Alexandria & Curry, Adrienne. (2001). Service improvements in public services using SERVQUAL. Managing Service Quality. 11. 389-401. 10.1108/09604520110410601.

Buttle, F. (1996). SERVQUAL: Review, Critique, Research Agenda. European Journal of Marketing, 30, 8-32. https://doi.org/10.1108/03090569610105762

Cao, C., Wei, T., Xu, S. et al. Comprehensive evaluation of higher education systems using indicators: PCA and EWM methods. Humanit Soc Sci Commun 10, 432 (2023). https://doi.org/10.1057/s41599-023-01938-x

Carnerud, D. (2018), “25 years of quality management research – outlines and trends Daniel”, International Journal of Quality and Reliability Management, Vol. 35 No. 1, pp. 208-231.

Coelli, T.J., Prasada Rao, D.S., O’Donnell, C.J. and Battese, G.E. (2005) An Introduction to Efficiency and Productivity Analysis, Springer, New York

Crosby, P.B. (1979) Quality Is Free: The Art of Making Quality Certain. McGraw-Hill, New York

Daghbashyan, Zara. (2011). The Economic Efficiency of Swedish Higher Education Institutions

D’ELIA, Vanesa, FERRO, Gustavo. Efficiency in public higher education: A stochastic frontier analysis considering heterogeneity. RAE [online]. 2021, vol.36, n.2, pp.21-51. ISSN 0718-8870. http://dx.doi.org/10.4067/S0718-88702021000200021.

Deming, W. E. (1982). Quality, Productivity and Competition Position (p. 17). Cambridge, MA: MIT Press.

Ferro G., D‘Elia V. (2020) ‘Higher Education Efficiency Frontier Analysis: A Review of Variables to Consider’, Journal on Efficiency and Responsibility in Education and Science, vol. 13, no. 3, pp. 140-153. http://dx.doi.org/10.7160/eriesj.2020.130304

Gummesson, E. (1990), Service Quality – A Holistic View, CTF, Karlstad

Gupta P, Mehrotra D, Sharma TK (2015) Identifying knowledge indicators in higher education organization. Procedia Comput Sci 46:449–456

Ishikawa, K. (1985) What Is Total Quality Control? The Japanese Way. Translated by Lu, D.J., Prentice-Hall, Englewood Cliffs, New Jersey.

Johnes, J., Data envelopment analysis and its application to the measurement of efficiency in higher education, Economics of Education Review, Volume 25, Issue 3, 2006, pages 273-288, ISSN 0272-7757, https://doi.org/10.1016/j.econedurev.2005.02.005.

Johnes, G., & Johnes, J. (1993). Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis. Oxford Economic Papers, 45(2), 332–347. http://www.jstor.org/stable/2663642

Johnes, G., Johnes, J. and Thanassoulis, E. (2008) ‘An Analysis of Costs in Institutions of Higher Education in England’, Studies in Higher Education, Vol. 33, No. 5, pp. 527-549. https://doi.org/10.1080/03075070802372901

Johnson, R.H. and Winchell, W.O. (1988), “Educating for quality”, Quality Progress, Vol. 2, September, pp. 48-50.

Kayyali, Mustafa. "An Overview of Quality Assurance in Higher Education: Concepts and Frameworks." International Journal of Management, Sciences, Innovation, and Technology IJMSIT, vol. 4, no. 2, 2023, pp. 01-04.

Kehm, B. M., & Teichler, U. (Eds.). (2020). The rise of quality assurance in higher education: International challenges and practices. Springer.

Köksal, Gülser & Nalçaci, Burak. (2006). The Relative Efficiency of Departments at a Turkish Engineering College: A Data Envelopment Analysis. Higher Education. 51. 173-189. 10.1007/s10734-004-6380-y

Lüdecke, D., Makowski, D., Ben-Shachar, M. S., Patil, I., Wiernik, B. M., Bacher, Etienne, & Thériault, R. (2023). easystats: Streamline model interpretation, visualization, and reporting (0.7.3) [R package]. https://easystats.github.io/easystats/ (Original work published 2019)

Madden, G., Savage, S., & Kemp, S. (1997). Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities. Education Economics, 5(2), 153–168. https://doi.org/10.1080/09645299700000013

Mastromarco, C. (2008). STOCHASTIC FRONTIER MODELS. http://www.camillamastromarco.it/CIDE/STFR.pdf

Michael, S.O. (1998), “Restructuring US higher education: analyzing models for academic program review and discontinuation”, Association for the Study of Higher Education, Vol. 21 No. 4, pp. 377-404.

Middlehurst, R. (1992), “Quality: an organising principle for higher education”, Higher Education Quarterly, Vol. 46 No. 1, pp. 20-38.

Middlehurst, R. and Gordon, G. (1995), “Leadership, quality and institutional effectiveness”, Higher Education Quarterly, Vol. 49 No. 3, pp. 267-85.

Moreno, Abel & Tadepalli, Raghu. (2002). Assessing Academic Department Efficiency at a Public University. Managerial and Decision Economics. 23. 385-397. 10.1002/mde.1075 OECD (2008), Handbook on Constructing Composite Indicators. Methodology and User Guide, European Commission

Parri, J. (2006), “Quality in higher education”, Vadyba/Management, Vol. 2 No. 11, pp. 107-11

Robst, J. (1997): Cost Efficiency in Public Higher Education. Binghamton: Department of Economics, SUNY

Sav, G.T. (2016) ‘Declining State Funding and Efficiency Effects on Public Higher Education: Government Really Does Matter’, International Advances in Economic Research, Vol. 22, No. 4, pp. 397–408. https://doi.org/10.1007/s11294-016-9602-z

Thursby, Jerry. (2000). What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research. Journal of Economic Literature. 38. 383-404. 10.1257/jel.38.2.383

Van Mol C, Caarls K, Souto-Otero M (2021) International student mobility and labour market outcomes: an investigation of the role of level of study, type of mobility, and international prestige hierarchies. High Educ 82(6):1145–1171

Weckenmann, A., Akkasoglu, G. and Werner, T. (2015), “Quality management – history and trend”, The TQM Journal, Vol. 27 No. 3, pp. 281-293.

Wiethe-Körprich, Michaela & Bley (geb. Trost), Sandra. (2017). Prospective educators as consumers of empirical research: an authentic assessment approach to make their competencies visible. Empirical Research in Vocational Education Training. 9. 1-26. 10.1186/s40461‑017‑0052‑5.