Discriminating Behavior: Evidence from teachers’ grading bias

Ferman, Bruno and Fontes, Luiz Felipe (2020): Discriminating Behavior: Evidence from teachers’ grading bias.

Abstract

Recent evidence has established that non-cognitive skills are key determinants of education and labor outcomes, and are malleable throughout adolescence. However, little is known about the mechanisms producing these results. This paper tests a channel that could explain part of the association between non-cognitive skills and important outcomes: teacher grading discrimination toward student behaviors. Evidence is drawn from a unique data pertaining to students from middle and high-school in Brazilian private schools. Our empirical strategy is based on the contrasting of school-level tests graded by teachers and school-level tests that cover the same content but are graded blindly. Using detailed data on student classroom behaviors and holding constant performance in exams graded blindly, evidence indicates that teachers inflate the grades of better-behaved students while deducting points from worse-behaved ones. These biases are driven by grading discrimination in exams with open questions. Additionally, teachers’ behavior does not appear to be consistent with statistical discrimination.

• Item Type: MPRA Paper
• Language: English
• Keywords: Grade discrimination; non-cognitive skills
• Subjects: I - Health, Education, and Welfare > I2 - Education and Research Institutions > I21 - Analysis of Education; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I24 - Education and Inequality

References

Alan, S., Boneva, T., and Ertac, S. (2019). Ever failed, try again, succeed better: Results from a randomized educational intervention on grit. The Quarterly Journal of Economics, 134(3):1121–1162.

Alan, S. and Ertac, S. (2018). Fostering patience in the classroom: Results from randomized educational intervention. Journal of Political Economy, 126(5):1865–1911.

Alesina, A., Carlana, M., Ferrara, E. L., and Pinotti, P. (2018). Revealing stereotypes: Evidence from immigrants in schools. Technical report, National Bureau of Economic Research.

Almlund, M., Duckworth, A. L., Heckman, J., and Kautz, T. (2011). Personality psychology and economics. In Handbook of the Economics of Education, volume 4, pages 1–181. Elsevier.

Altonji, J. G., Elder, T. E., and Taber, C. R. (2005). Selection on observed and unobserved variables: Assessing the effectiveness of catholic schools. Journal of political economy, 113(1):151–184.

Altonji, J. G. and Pierret, C. R. (2001). Employer learning and statistical discrimination. The Quarterly Journal of Economics, 116(1):313–350. Arrow, K. J. (1972). Models of job discrimination. Racial discrimination in economic life, 83. Becker, G. S. (2010). The economics of discrimination. University of Chicago press.

Bertrand, M. and Pan, J. (2013). The trouble with boys: Social influences and the gender gap in disruptive behavior. American Economic Journal: Applied Economics, 5(1):32–64.

Bond, T. N. and Lang, K. (2018). The black–white education scaled test-score gap in grades k-7. Journal of Human Resources, 53(4):891–917. Borghans, L., Golsteyn, B. H., Heckman, J. J., and Humphries, J. E. (2016). What grades and achievement tests measure. Proceedings of the National Academy of Sciences, 113(47):13354– 13359.

Borghans, L., Meijers, H., and Ter Weel, B. (2008). The role of noncognitive skills in explaining cognitive test scores. Economic inquiry, 46(1):2–12.

Botelho, F., Madeira, R. A., and Rangel, M. A. (2015). Racial discrimination in grading: Evidence from brazil. American Economic Journal: Applied Economics, 7(4):37–52.

Breda, T. and Ly, S. T. (2015). Professors in core science fields are not always biased against women: Evidence from france. American Economic Journal: Applied Economics, 7(4):53–75.

Burgess, S. and Greaves, E. (2013). Test scores, subjective assessment, and stereotyping of ethnic minorities. Journal of Labor Economics, 31(3):535–576.

Castillo, M., Ferraro, P. J., Jordan, J. L., and Petrie, R. (2011). The today and tomorrow of kids: Time preferences and educational outcomes of children. Journal of Public Economics, 95(11-12):1377–1385.

Cizek, G. J., Fitzgerald, S. M., and Rachor, R. A. (1995). Teachers' assessment practices: Preparation, isolation, and the kitchen sink. Educational assessment, 3(2):159–179.

Cornwell, C., Mustard, D. B., and Van Parys, J. (2013). Noncognitive skills and the gender disparities in test scores and teacher assessments: Evidence from primary school. Journal of Human resources, 48(1):236–264.

Crede´, M. and Kuncel, N. R. (2008). Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on psychological science, 3(6):425– 453.

Cubel, M., Nuevo-Chiquero, A., Sanchez-Pages, S., and Vidal-Fernandez, M. (2016). Do personality traits affect productivity? evidence from the laboratory. The Economic Journal, 126(592):654–681.

De Paola, M. and Gioia, F. (2017). Impatience and academic performance. less effort and less ambitious goals. Journal of Policy Modeling, 39(3):443–460.

Dee, T. S., Dobbie, W., Jacob, B. A., and Rockoff, J. (2019). The causes and consequences of test score manipulation: Evidence from the new york regents examinations. American Economic Journal: Applied Economics, 11(3):382–423.

Deming, D. J. (2017). The growing importance of social skills in the labor market. The Quarterly Journal of Economics, 132(4):1593–1640.

Diamond, R. and Persson, P. (2016). The long-term consequences of teacher discretion in grading of high-stakes tests. Technical report, National Bureau of Economic Research.

Duckworth, A. L. and Allred, K. M. (2012). Temperament in the classroom.

Duckworth, A. L. and Seligman, M. E. (2005). Self-discipline outdoes iq in predicting academic performance of adolescents. Psychological science, 16(12):939–944.

Falch, T. and Naper, L. R. (2013). Educational evaluation schemes and gender gaps in student achievement. Economics of Education Review, 36:12–25.

Farrington, C. A., Roderick, M., Allensworth, E., Nagaoka, J., Keyes, T. S., Johnson, D. W., and Beechum, N. O. (2012). Teaching Adolescents to Become Learners: The Role of Noncognitive Factors in Shaping School Performance–A Critical Literature Review. ERIC.

Frary, R. B., Cross, L. H., and Weber, L. J. (1993). Testing and grading practices and opinions of secondary teachers of academic subjects: Implications for instruction in measurement. Educational Measurement: Issues and Practice, 12(3):23–30.

Hanna, R. N. and Linden, L. L. (2012). Discrimination in grading. American Economic Journal: Economic Policy, 4(4):146–68.

Heckman, J. J., Jagelka, T., and Kautz, T. D. (2019). Some contributions of economics to the study of personality. Technical report, National Bureau of Economic Research.

Heckman, J. J. and Kautz, T. (2012). Hard evidence on soft skills. Labour economics, 19(4):451– 464.

Heckman, J. J., Pinto, R., and Savelyev, P. (2013). Understanding the mechanisms through which an influential early childhood program boosted adult outcomes. American Economic Review, 103(6):2052–86.

Heckman, J. J., Stixrud, J., and Urzua, S. (2006). The effects of cognitive and noncognitive abilities on labor market outcomes and social behavior. Journal of Labor economics, 24(3):411– 482.

Hinnerich, B. T., Höglin, E., and Johannesson, M. (2011). Are boys discriminated in swedish high schools? Economics of Education review, 30(4):682–690.

Jackson, C. K. (2018). What do test scores miss? the importance of teacher effects on non–test score outcomes. Journal of Political Economy, 126(5):2072–2107.

Jackson, C. K., Porter, S. C., Easton, J. Q., Blanchard, A., and Kiguel, S. (2020). School effects on socio-emotional development, school-based arrests, and educational attainment. Technical report, National Bureau of Economic Research.

Jae, H. and Cowling, J. (2009). Objectivity in grading: The promise of bar codes. College Teaching, 57(1):51–55.

Kautz, T. and Zanoni, W. (2014). Measuring and fostering non-cognitive skills in adolescence: Evidence from Chicago Public Schools and the OneGoal Program. University of Chicago Chicago, IL.

Keogh, B. K. (1986). Temperament and schooling: meaning of" goodness of fit"? New directions for child development.

Khwaja, A. I., Andrabi, T., Das, J., Zajonc, T., et al. (2011). Do value-added estimates add value? accounting for learning dynamics. American Economic Journal: Applied Economics.

Lange, F. (2007). The speed of employer learning. Journal of Labor Economics, 25(1):1–35.

Lavecchia, A. M., Liu, H., and Oreopoulos, P. (2016). Behavioral economics of education: Progress and possibilities. In Handbook of the Economics of Education, volume 5, pages 1–74. Elsevier.

Lavy, V. (2008). Do gender stereotypes reduce girls' or boys' human capital outcomes? evidence from a natural experiment. Journal of Political Economy, 92(10-11):2083–2105.

Lavy, V. and Sand, E. (2018). On the origins of gender gaps in human capital: Short-and long-term consequences of teachers' biases. Journal of Public Economics, 167:263–279.

Lerner, J. V., Lerner, R. M., and Zabski, S. (1985). Temperament and elementary school children's actual and rated academic performance: A test of a goodness-of-fit'model. Journal of Child Psychology and Psychiatry, 26(1):125–136.

Lockwood, J. and McCaffrey, D. F. (2014). Correcting for test score measurement error in ancova models for estimating treatment effects. Journal of Educational and Behavioral Statistics, 39(1):22–52.

Lubbers, M. J., Van Der Werf, M. P., Kuyper, H., and Hendriks, A. J. (2010). Does homework behavior mediate the relation between personality and academic performance? Learning and Individual differences, 20(3):203–208.

McMillan, J. H. (2001). Secondary teachers' classroom assessment and grading practices. Educational Measurement: Issues and Practice, 20(1):20–32.

McMillan, J. H. (2003). Understanding and improving teachers' classroom assessment decision making: Implications for theory and practice. Educational measurement: Issues and practice, 22(4):34–43.

McMillan, J. H. (2013). SAGE handbook of research on classroom assessment. Sage.

McMillan, J. H., Myran, S., and Workman, D. (2002). Elementary teachers' classroom assessment and grading practices. The journal of educational research, 95(4):203–213.

Mechtenberg, L. (2009). Cheap talk in the classroom: How biased grading at school explains gender differences in achievements, career choices and wages. The review of economic studies, 76(4):1431–1459.

Non, A. and Tempelaar, D. (2016). Time preferences, study effort, and academic performance. Economics of Education Review, 54:36–61.

Nordin, M., Heckley, G., and Gerdtham, U. (2019). The impact of grade inflation on higher education enrolment and earnings. Economics of Education Review, 73:101936.

Oster, E. (2019). Unobservable selection and coefficient stability: Theory and evidence. Journal of Business & Economic Statistics, 37(2):187–204.

Papageorge, N. W., Ronda, V., and Zheng, Y. (2019). The economic value of breaking bad: Misbehavior, schooling and the labor market. Technical report, National Bureau of Economic Research.

Phelps, E. S. (1972). The statistical theory of racism and sexism. The american economic review, 62(4):659–661.

Piche´, G. L., Michlin, M., Rubin, D., and Sullivan, A. (1977). Effects of dialect-ethnicity, social class and quality of written compositions on teachers' subjective evaluations of children. Communications Monographs, 44(1):60–72.

Roen, D. (1992). Gender and teacher response to student writing. In Gender issues in the teaching of English, pages 126–141. Heinemann.

Segal, C. (2008). Classroom behavior. Journal of Human Resources, 43(4):783–814.

Segal, C. (2012). Working when no one is watching: Motivation, test scores, and economic success. Management Science, 58(8):1438–1457.

Segal, C. (2013). Misbehavior, education, and labor market outcomes. Journal of the European Economic Association, 11(4):743–779.

Starch, D. and Elliott, E. (1912). Reliability of grading high-school work in english. The School Review, 20(7):442–457.

Sutter, M., Kocher, M. G., Glätzle-Rützler, D., and Trautmann, S. T. (2013). Impatience and uncertainty: Experimental decisions predict adolescents' field behavior. American Economic Review, 103(1):510–31.

Terrier, C. (2016). Boys lag behind: How teachers' gender biases affect student achievement. IZA Discussion Paper.

Thomas, A. and Chess, S. (1977). Temperament and development. Brunner/Mazel.

Wen, S.-s. (1979). Racial halo on evaluative rating: General or differential? Contemporary Educational Psychology, 4(1):15–19.