The Efficiency of Australian Schools: Evidence from the NAPLAN Data 2009-2011

Nghiem, Son and Nguyen, Ha and Connelly, Luke (2014): The Efficiency of Australian Schools: Evidence from the NAPLAN Data 2009-2011.

Abstract

This study examines the technical efficiency of schools in Australia and its determinants using NAPLAN test results of about 6,800 schools in 2009-2011 and other information from the “My School” website. For each school, we use the average growth of test scores for the same students between 2009 and 2011 as the measure of the school's output and four input measures: the student-teacher ratios, student-non-teaching staff ratios, recurrent income per student and (averaged) capital expenditure per student. We are also able to compare schools by type: including whether or not the school is a public school or a private school, a single sex or co-educational schools, a primary or secondary school, or a school that provides both primary and secondary schooling. In addition we control for several other environmental indicators for each school including: an index of social and educational advantage, the proportion of school children who identify as an Aborigine or Torres Strait Islander, the proportion of students from a non English-speaking background, the proportion of students female, as well as the region, state and territory in which the school is located. We estimate that the average technical efficiency score of Australian schools is 59 per cent and find evidence of input congestion for all of the inputs studied. On average, the growth target for schools in the sample to reach the efficiency frontier is 100 NAPLAN points. Our results suggest that eliminating inputs congestion could, in theory, reduce expenditure per school student by A$2,000. At the primary level, Catholic and independent schools are less efficient than public schools, but this story is reversed at the secondary level. We also find that schools with students from more advantageous social and economic backgrounds and schools with higher ratios of students from non-English speaking backgrounds tend to be more efficient. The results are robust to the choices about how to construct the frontier (e.g., in aggregate or for disaggregates by school type) and to our treatments of output and super-efficiency.

• Item Type: MPRA Paper
• Language: English
• Keywords: Efficiency, Australia, data envelopment analysis, double bootstrap
• Subjects: D - Microeconomics > D2 - Production and Organizations > D24 - Production ; Cost ; Capital ; Capital, Total Factor, and Multifactor Productivity ; Capacity; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I21 - Analysis of Education

References

ACARA (2013a): "My School Student Gain," Report, The Australian Curriculum, Assessment and Reporting Authority.

--- (2013b): "Reliability and validity of NAPLAN," Report, The Australian Curriculum, Assessment and Reporting Authority.

--- (2013c): "Report on the generation of the 2012 Index of Community Socio-educational Advantage (ICSEA)," Report, The Australian Curriculum, Assessment and Reporting Authority.

Agasisti, T. (2011): "The efficiency of Italian secondary schools and the potential role of competition: a data envelopment analysis using OECD-PISA2006 data," Education Economics, 21, 520-544.

Alexander, W. R., A. Haug, and M. Jaforullah (2010): "A two-stage double-bootstrap data envelopment analysis of efficiency differences of New Zealand secondary schools," Journal of Productivity Analysis, 34, 99-110.

Bastian, M., S. Heymann, and M. Jacomy (2009): "Gephi: an open source software for exploring and manipulating networks," in International AAAI Conference on Weblogs and Social Media.

Battese, G. E. and T. J. Coelli (1995): "A Model for Technical Inefficiency Effects in a Stochastic Frontier Production Function for Panel Data," Empirical Economics, 20, 325-332.

Blackburn, V., S. Brennan, and J. Ruggiero (2013): "Measuring efficiency in Australian Schools: A preliminary analysis," Socio-Economic Planning Sciences.

Bradley, S., M. Draca, and C. Green (2004): "School Performance in Australia: Is There a Role for Quasi-Markets?" Australian Economic Review, 37, 271-286.

Bradley, S., G. Johnes, and J. Millington (2001): "The effect of competition on the efficiency of secondary schools in England," European Journal of Operational Research, 135, 545-568.

Buddin, R. and G. Zamarro (2009): "Teacher qualifications and student achievement in urban elementary schools," Journal of Urban Economics, 66, 103-115.

Burney, N. A., J. Johnes, M. Al-Enezi, and M. Al-Musallam (2011): "The efficiency of public schools: the case of Kuwait," Education Economics, 21, 360-379.

Cardak, B. A. and J. Vecci (2013): "Catholic school effectiveness in Australia: A reassessment using selection on observed and unobserved variables," Economics of Education Review, 37, 34-45.

Chakraborty, K. and V. C. Blackburn (2013): "Efficiency and Equity in Funding for Government Schools in Australia," Australian Economic Papers, 52, 127-142.

Chakraborty, K. and J. Poggio (2008): "Efficiency and equity in school funding: a case study for Kansas," International Advances in Economic Research, 14, 228-241.

Cherchye, L., K. De Witte, E. Ooghe, and I. Nicaise (2010): "Efficiency and equity in private and public education: A nonparametric comparison," European Journal of Operational Research, 202, 563-573.

Coelli, T., D. Rao, C. O’Donnell, and G. Battese (2005): An Introduction to Efficiency and Productivity Analysis, New York: Springer Science, 2nd ed.

Conroy, S. J. and N. M. Arguea (2008): "An estimation of technical efficiency for Florida public elementary schools," Economics of Education Review, 27, 655-663.

Daraganova, G., B. Edwards, and M. Sipthorp (2013): "Using National Assessment Program-Literacy and Numeracy (NAPLAN) data in the Longitudinal Study of Australian Children (LSAC)," Tech. rep., Australian Institute of Family Studies.

Elder, T. and C. Jepsen (2014): "Are Catholic primary schools more effective than public primary schools?" Journal of Urban Economics, 80, 28-38.

Essid, H., P. Ouellette, and S. Vigeant (2011): "Small is not that beautiful after all: measuring the scale efficiency of Tunisian high schools using a DEA-bootstrap method," Applied Economics, 45, 1109-1120.

Gonski, D., K. Boston, K. Greiner, C. Lawrence, B. Scales, and P. Tannock (2011): "Review of Funding for Schooling - Final report," Report.

Gronberg, T. J., D. W. Jansen, and L. L. Taylor (2012): "The relative efficiency of charter schools: A cost frontier approach," Economics of Education Review, 31, 302-317.

Grosskopf, S., K. J. Hayes, and L. L. Taylor (2009): "The relative efficiency of charter schools," Annals of Public and Cooperative Economics, 80,67-87.

Grosskopf, S. and C. Moutray (2001): "Evaluating performance in Chicago public high schools in the wake of decentralization," Economics of Education Review, 20, 1-14.

Haelermans, C., K. De Witte, and J. L. T. Blank (2012): "On the allocation of resources for secondary schools," Economics of Education Review, 31, 575-586.

Haelermans, C. and J. Ruggiero (2013): "Estimating technical and allocative efficiency in the public sector: A nonparametric analysis of Dutch schools," European Journal of Operational Research, 227, 174-181.

Hanushek, E. A., J. F. Kain, S. G. Rivkin, and G. F. Branch (2007): "Charter school quality and parental decision making with school choice," Journal of Public Economics, 91, 823-848.

Hanushek, E. A. and L. L. Taylor (1990): "Alternative assessments of the performance of schools: measurement of state variations in achievement," Journal of Human Resources, 179-201.

Haug, A. A. and V. C. Blackburn (2013a): "Efficiency Aspects of Government Secondary School Finances in New South Wales: Results from a Two-Stage Double-Bootstrap DEA at the School Level,".

--- (2013b): "Efficiency Aspects of Government Secondary School Finances in New South Wales: Results from a Two-Stage Double-Bootstrap DEA at the School Level,".

Jepsen, C. (2003): "The Effectiveness of Catholic Primary Schooling," The Journal of Human Resources, 38, 928-941.

Kirjavainen, T. (2011): "Efficiency of Finnish general upper secondary schools: an application of stochastic frontier analysis with panel data," Education Economics, 20, 343-364.

Lamb, S., R. Rumberger, D. Jesson, and R. Teese (2004): "School performance in Australia: results from analyses of school effectiveness," Tech. rep., Centre for Post-compulsory Education and Lifelong Learning.

Leigh, A. (2010): "Estimating teacher effectiveness from two-year changes in students’ test scores," Economics of Education Review, 29, 480-488.

Loman, N. J., R. V. Misra, T. J. Dallman, C. Constantinidou, S. E. Gharbia, J. Wain, and M. J. Pallen (2012): "Performance comparison of benchtop high-throughput sequencing platforms," Nature biotechnology, 30,434-439.

Malmquist, S. (1953): "Index Numbers and Indifference Surfaces," Trabajos de Estatistica, 4, 209-242.

Mancebón, M.-J., J. Calero, A. Choi, and D. P. XimØnez-de Embœn (2012): "The efficiency of public and publicly subsidized high schools in Spain: Evidence from PISA-2006," Journal of the Operational Research Society, 63, 1516-1533. Mante, B. and G. O’Brien (2002): "Efficiency measurement of Australian public sector organisations: The case of state secondary schools in Victoria," Journal of Educational Administration, 40, 274-298.

Marks, G. N. (2007): "Do Schools Matter for Early School Leaving? Individual and School Influences in Australia," School Effectiveness and School Improvement, 18, 429-450.

--- (2009): "Accounting for School-sector Differences in University Entrance Performance," The Australian Journal of Education, 53, 19-38.

Marks, G. N., J. McMillan, and K. Hillman (2001): "Tertiary entrance performance: The role of student background and school factors," Research report number 22, Research Report Number 22, Australian Council for Educational Research (ACER).

Masters, G. N. (2012): "Measuring and Rewarding School Improvement,".

MCEERYA (2008a): "MCEETYA four-year plan 2009 - 2012: A companion document for the Melbourne Declaration on Educational Goals for Young Australians," Report, the Ministerial Council on Education, Employment, Training and Youth Affairs.

--- (2008b): "Melbourne Declaration on Educational Goals for Young Australians," Report, the Ministerial Council on Education, Employment, Training and Youth Affairs.

Miller, P. W. and D. Voon (2012): "Government Versus Non-Government Schools: A Nation-Wide Assessment Using Australian Naplan Data," Australian Economic Papers, 51, 147-166.

Nghiem, H. S., H. Nguyen, R. Khanam, and L. Connelly (2013): "Does school type affect academic achievement in young children? Evidence from Australia," in Growing Up in Australia and Footprints in Time, LSAC and LSIC Research Conference.

Ouellette, P. and V. Vierstraete (2005): "An evaluation of the efficiency of Quebec’s school boards using the Data Envelopment Analysis method," Applied Economics, 37, 1643-1653.

R Core Team (2013): R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria.

Reback, R. (2008): "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, 92, 1394-1415.

Ryan, C. (2013): "What is behind the decline in student achievement in Australia?" Economics of Education Review, 37, 226-239.

Ryan, C. and L. Watson (2010): "The Impact of School Choice on Students’ University Entrance Rank Scores in Australia," in Society of Labor Economists Conference, London , 17-19 June.

Shephard, R. W. (1953): Cost and production functions, Princeton: Princeton University Press.

Simar, L. and P. W. Wilson (1998): "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, 44, 49-61.

--- (2007): "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, 136, 31-64.

Street, A. (2003): "How much confidence should we place in efficiency estimates?" Health Economics, 12, 895-907.

Vella, F. (1999): "Do Catholic Schools Make a Difference? Evidence from Australia," The Journal of Human Resources, 34, 208-224.

Wilson, P. (2008): "FEAR 1.0: A software package for frontier efficiency analysis with R," Socio-Economic Planning Sciences, 42, 247-254.

Zoghbi, A. C., F. Rocha, and E. Mattos (2013): "Education production efficiency: Evidence from Brazilian universities," Economic Modelling, 31, 94-103.