Discriminating Behavior: Evidence from teachers’ grading bias

Ferman, Bruno and Fontes, Luiz Felipe (2020): Discriminating Behavior: Evidence from teachers’ grading bias.

Abstract

Recent evidence has established that non-cognitive skills are key determinants of education and labor outcomes. However, little is known about the mechanisms producing these results. This paper tests a channel that could explain part of the association between some non-cognitive characteristics and educational attainment: teachers' assessment practices that unequally evaluate students on the basis of their classroom behavior rather than their scholastic competence. Evidence is drawn from unique data on middle- and high-school students in Brazilian private schools. Our main empirical strategy is based on the contrasting of teacher-assigned and blindly-assigned scores on achievement tests that are high-stakes and cover the same material. Using detailed data on student classroom behaviors and holding constant performance in exams graded blindly, evidence indicates that teachers inflate test scores of better-behaved students, and deduct points from worse-behaved ones. We also find that, conditional on end-of-year grade, teachers' decision to approve pupils that are bellow the passing cutoff grade is influenced by how these students behaved in class. Back of the envelope calculations suggest that this grading behavior may significantly change the proportion of students failing the school year depending on their classroom attitudes.

• Item Type: MPRA Paper
• Language: English
• Keywords: Grade discrimination; non-cognitive skills
• Subjects: I - Health, Education, and Welfare > I2 - Education and Research Institutions > I21 - Analysis of Education; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I24 - Education and Inequality

References

Alan, S., Boneva, T., and Ertac, S. (2019). Ever failed, try again, succeed better: Results from a randomized educational intervention on grit. The Quarterly Journal of Economics, 134(3):1121–1162.

Alan, S. and Ertac, S. (2018). Fostering patience in the classroom: Results from randomized educational intervention. Journal of Political Economy, 126(5):1865–1911.

Alesina, A., Carlana, M., Ferrara, E. L., and Pinotti, P. (2018). Revealing stereotypes: Evidence from immigrants in schools. Technical report, National Bureau of Economic Research.

Almlund, M., Duckworth, A. L., Heckman, J., and Kautz, T. (2011). Personality psychology and economics. In Handbook of the Economics of Education, volume 4, pages 1–181. Elsevier.

Altonji, J. G., Elder, T. E., and Taber, C. R. (2005). Selection on observed and unobserved variables: Assessing the effectiveness of catholic schools. Journal of political economy, 113(1):151–184.

Altonji, J. G. and Pierret, C. R. (2001). Employer learning and statistical discrimination. The Quarterly Journal of Economics, 116(1):313–350. Arrow, K. J. (1972). Models of job discrimination. Racial discrimination in economic life, 83. Becker, G. S. (2010). The economics of discrimination. University of Chicago press.

Bertrand, M. and Pan, J. (2013). The trouble with boys: Social influences and the gender gap in disruptive behavior. American Economic Journal: Applied Economics, 5(1):32–64.

Bond, T. N. and Lang, K. (2018). The black–white education scaled test-score gap in grades k-7. Journal of Human Resources, 53(4):891–917. Borghans, L., Golsteyn, B. H., Heckman, J. J., and Humphries, J. E. (2016). What grades and achievement tests measure. Proceedings of the National Academy of Sciences, 113(47):13354– 13359.

Borghans, L., Meijers, H., and Ter Weel, B. (2008). The role of noncognitive skills in explaining cognitive test scores. Economic inquiry, 46(1):2–12.

Botelho, F., Madeira, R. A., and Rangel, M. A. (2015). Racial discrimination in grading: Evidence from brazil. American Economic Journal: Applied Economics, 7(4):37–52.

Breda, T. and Ly, S. T. (2015). Professors in core science fields are not always biased against women: Evidence from france. American Economic Journal: Applied Economics, 7(4):53–75.

Burgess, S. and Greaves, E. (2013). Test scores, subjective assessment, and stereotyping of ethnic minorities. Journal of Labor Economics, 31(3):535–576.

Castillo, M., Ferraro, P. J., Jordan, J. L., and Petrie, R. (2011). The today and tomorrow of kids: Time preferences and educational outcomes of children. Journal of Public Economics, 95(11-12):1377–1385.

Cizek, G. J., Fitzgerald, S. M., and Rachor, R. A. (1995). Teachers' assessment practices: Preparation, isolation, and the kitchen sink. Educational assessment, 3(2):159–179.

Cornwell, C., Mustard, D. B., and Van Parys, J. (2013). Noncognitive skills and the gender disparities in test scores and teacher assessments: Evidence from primary school. Journal of Human resources, 48(1):236–264.

Crede´, M. and Kuncel, N. R. (2008). Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on psychological science, 3(6):425– 453.

Cubel, M., Nuevo-Chiquero, A., Sanchez-Pages, S., and Vidal-Fernandez, M. (2016). Do personality traits affect productivity? evidence from the laboratory. The Economic Journal, 126(592):654–681.

De Paola, M. and Gioia, F. (2017). Impatience and academic performance. less effort and less ambitious goals. Journal of Policy Modeling, 39(3):443–460.

Dee, T. S., Dobbie, W., Jacob, B. A., and Rockoff, J. (2019). The causes and consequences of test score manipulation: Evidence from the new york regents examinations. American Economic Journal: Applied Economics, 11(3):382–423.

Deming, D. J. (2017). The growing importance of social skills in the labor market. The Quarterly Journal of Economics, 132(4):1593–1640.

Diamond, R. and Persson, P. (2016). The long-term consequences of teacher discretion in grading of high-stakes tests. Technical report, National Bureau of Economic Research.

Duckworth, A. L. and Allred, K. M. (2012). Temperament in the classroom.

Duckworth, A. L. and Seligman, M. E. (2005). Self-discipline outdoes iq in predicting academic performance of adolescents. Psychological science, 16(12):939–944.

Falch, T. and Naper, L. R. (2013). Educational evaluation schemes and gender gaps in student achievement. Economics of Education Review, 36:12–25.

Farrington, C. A., Roderick, M., Allensworth, E., Nagaoka, J., Keyes, T. S., Johnson, D. W., and Beechum, N. O. (2012). Teaching Adolescents to Become Learners: The Role of Noncognitive Factors in Shaping School Performance–A Critical Literature Review. ERIC.

Ferman, B. (2019). A simple way to assess inference methods. arXiv preprint arXiv:1912.08772.

Frary, R. B., Cross, L. H., and Weber, L. J. (1993). Testing and grading practices and opinions of secondary teachers of academic subjects: Implications for instruction in measurement. Educational Measurement: Issues and Practice, 12(3):23–30.

Hanna, R. N. and Linden, L. L. (2012). Discrimination in grading. American Economic Journal: Economic Policy, 4(4):146–68.

Heckman, J. J., Jagelka, T., and Kautz, T. D. (2019). Some contributions of economics to the study of personality. Technical report, National Bureau of Economic Research.

Heckman, J. J. and Kautz, T. (2012). Hard evidence on soft skills. Labour economics, 19(4):451– 464.

Heckman, J. J., Pinto, R., and Savelyev, P. (2013). Understanding the mechanisms through which an influential early childhood program boosted adult outcomes. American Economic Review, 103(6):2052–86.

Heckman, J. J., Stixrud, J., and Urzua, S. (2006). The effects of cognitive and noncognitive abilities on labor market outcomes and social behavior. Journal of Labor economics, 24(3):411– 482.

Hinnerich, B. T., Höglin, E., and Johannesson, M. (2011). Are boys discriminated in swedish high schools? Economics of Education review, 30(4):682–690.

Jackson, C. K. (2018). What do test scores miss? the importance of teacher effects on non–test score outcomes. Journal of Political Economy, 126(5):2072–2107.

Jackson, C. K., Porter, S. C., Easton, J. Q., Blanchard, A., and Kiguel, S. (2020). School effects on socio-emotional development, school-based arrests, and educational attainment. Technical report, National Bureau of Economic Research.

Jae, H. and Cowling, J. (2009). Objectivity in grading: The promise of bar codes. College Teaching, 57(1):51–55.

Kautz, T. and Zanoni, W. (2014). Measuring and fostering non-cognitive skills in adolescence: Evidence from Chicago Public Schools and the OneGoal Program. University of Chicago Chicago, IL.

Keogh, B. K. (1986). Temperament and schooling: meaning of" goodness of fit"? New directions for child development.

Khwaja, A. I., Andrabi, T., Das, J., Zajonc, T., et al. (2011). Do value-added estimates add value? accounting for learning dynamics. American Economic Journal: Applied Economics.

Lange, F. (2007). The speed of employer learning. Journal of Labor Economics, 25(1):1–35.

Lavecchia, A. M., Liu, H., and Oreopoulos, P. (2016). Behavioral economics of education: Progress and possibilities. In Handbook of the Economics of Education, volume 5, pages 1–74. Elsevier.

Lavy, V. (2008). Do gender stereotypes reduce girls' or boys' human capital outcomes? evidence from a natural experiment. Journal of Political Economy, 92(10-11):2083–2105.

Lavy, V. and Sand, E. (2018). On the origins of gender gaps in human capital: Short-and long-term consequences of teachers' biases. Journal of Public Economics, 167:263–279.

Lerner, J. V., Lerner, R. M., and Zabski, S. (1985). Temperament and elementary school children's actual and rated academic performance: A test of a goodness-of-fit'model. Journal of Child Psychology and Psychiatry, 26(1):125–136.

Lockwood, J. and McCaffrey, D. F. (2014). Correcting for test score measurement error in ancova models for estimating treatment effects. Journal of Educational and Behavioral Statistics, 39(1):22–52.

Lubbers, M. J., Van Der Werf, M. P., Kuyper, H., and Hendriks, A. J. (2010). Does homework behavior mediate the relation between personality and academic performance? Learning and Individual differences, 20(3):203–208.

McMillan, J. H. (2001). Secondary teachers' classroom assessment and grading practices. Educational Measurement: Issues and Practice, 20(1):20–32.

McMillan, J. H. (2003). Understanding and improving teachers' classroom assessment decision making: Implications for theory and practice. Educational measurement: Issues and practice, 22(4):34–43.

McMillan, J. H. (2013). SAGE handbook of research on classroom assessment. Sage.

McMillan, J. H., Myran, S., and Workman, D. (2002). Elementary teachers' classroom assessment and grading practices. The journal of educational research, 95(4):203–213.

Mechtenberg, L. (2009). Cheap talk in the classroom: How biased grading at school explains gender differences in achievements, career choices and wages. The review of economic studies, 76(4):1431–1459.

Non, A. and Tempelaar, D. (2016). Time preferences, study effort, and academic performance. Economics of Education Review, 54:36–61.

Nordin, M., Heckley, G., and Gerdtham, U. (2019). The impact of grade inflation on higher education enrolment and earnings. Economics of Education Review, 73:101936.

Oster, E. (2019). Unobservable selection and coefficient stability: Theory and evidence. Journal of Business & Economic Statistics, 37(2):187–204.

Papageorge, N. W., Ronda, V., and Zheng, Y. (2019). The economic value of breaking bad: Misbehavior, schooling and the labor market. Technical report, National Bureau of Economic Research.

Phelps, E. S. (1972). The statistical theory of racism and sexism. The american economic review, 62(4):659–661.

Piche´, G. L., Michlin, M., Rubin, D., and Sullivan, A. (1977). Effects of dialect-ethnicity, social class and quality of written compositions on teachers' subjective evaluations of children. Communications Monographs, 44(1):60–72.

Roen, D. (1992). Gender and teacher response to student writing. In Gender issues in the teaching of English, pages 126–141. Heinemann.

Segal, C. (2008). Classroom behavior. Journal of Human Resources, 43(4):783–814.

Segal, C. (2012). Working when no one is watching: Motivation, test scores, and economic success. Management Science, 58(8):1438–1457.

Segal, C. (2013). Misbehavior, education, and labor market outcomes. Journal of the European Economic Association, 11(4):743–779.

Starch, D. and Elliott, E. (1912). Reliability of grading high-school work in english. The School Review, 20(7):442–457.

Sutter, M., Kocher, M. G., Glätzle-Rützler, D., and Trautmann, S. T. (2013). Impatience and uncertainty: Experimental decisions predict adolescents' field behavior. American Economic Review, 103(1):510–31.

Terrier, C. (2016). Boys lag behind: How teachers' gender biases affect student achievement. IZA Discussion Paper.

Thomas, A. and Chess, S. (1977). Temperament and development. Brunner/Mazel.

Wen, S.-s. (1979). Racial halo on evaluative rating: General or differential? Contemporary Educational Psychology, 4(1):15–19.