Normatively Framed Relative Performance Feedback – Field Experiment and Replication

Brade, Raphael and Himmler, Oliver and Jäckle, Robert (2018): Normatively Framed Relative Performance Feedback – Field Experiment and Replication.

Abstract

Feedback can help individuals put their performance into perspective, especially when transitioning into a new environment such as university or a different job. In a randomized field experiment we give first-year university students normatively framed relative performance feedback about their accumulated course credits. We find an increase in subsequent performance, but only when the feedback is positive. Using a regression discontinuity design, we show that the improved performance is not driven by unobserved characteristics of those receiving positive feedback, but that it is indeed due to the positive rather than negative nature of the feedback. We administer a replication experiment with the next wave of first-year students one year later and reproduce the results. Survey data provides suggestive evidence that positive feedback has an effect on behavior when students underestimate their relative performance, and that consistent with a mechanism of selective information processing, individuals focus on positive feedback to adjust their beliefs.

• Item Type: MPRA Paper
• Language: English
• Keywords: Relative Performance Feedback; Higher Education; Randomized Field Experiment; Replication; Selective Information Processing
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C93 - Field Experiments; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I23 - Higher Education ; Research Institutions

References

Allcott, Hunt, “Social Norms and Energy Conservation,” Journal of Public Economics, 2011, 95 (9), 1082–1095.

Allcott, Hunt and Todd Rogers, “The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation,” The American Economic Review, 2014, 104 (10), 3003–3037.

Azmat, Ghazala and Nagore Iriberri, “The Importance of Relative Performance Feedback Information: Evidence from a Natural Experiment using High School Students,” Journal of Public Economics, 2010, 94 (7), 435–452.

Azmat, Ghazala and Nagore Iriberri, “The Provision of Relative Performance Feedback: An Analysis of Performance and Satisfaction,” Journal of Economics & Management Strategy, 2016, 25 (1), 77–110.

Azmat, Ghazala, Manuel Bagues, Antonio Cabrales, and Nagore Iriberri, “What You Don’t Know... Can’t Hurt You? A Natural Field Experiment on Relative Performance Feedback in Higher Education,” mimeo, 2018.

Bandiera, Oriana, Iwan Barankay, and Imran Rasul, “Team Incentives: Evidence from a Firm Level Experiment,” Journal of the European Economic Association, 2013, 11 (5), 1079–1114.

Bandiera, Oriana, Valentino Larcinese, and Imran Rasul, “Heterogeneous Class Size Effects: New Evidence from a Panel of University Students,” The Economic Journal, 2010, 120 (549), 1365–1398.

Bandura, Albert, “Social Cognitive Theory of Self-Regulation,” Organizational Behavior and Human Decision Processes, 1991, 50 (2), 248 – 287.

Barankay, Iwan, “Rank Incentives: Evidence from a Randomized Workplace Experiment,” mimeo, 2012.

Bénabou, Roland and Jean Tirole, “Self-Confidence and Personal Motivation,” The Quarterly Journal of Economics, 2002, 117 (3), 871–915.

Bénabou, Roland and Jean Tirole, “Mindful Economics: The Production, Consumption, and Value of Beliefs,” Journal of Economic Perspectives, September 2016, 30 (3), 141–64.

Blanes i Vidal, Jordi and Mareike Nossol, “Tournaments Without Prizes: Evidence from Personnel Records,” Management Science, 2011, 57 (10), 1721–1736.

Bound, John, Michael F Lovenheim, and Sarah Turner, “Increasing Time to Baccalaureate Degree in the United States,” Education Finance and Policy, 2012, 7 (4), 375–424.

Brent, Daniel A, Corey Lott, Michael Taylor, Joseph Cook, Kimberly Rollins, and Shawn Stoddard, “Are Normative Appeals Moral Taxes? Evidence from a Field Experiment on Water Conservation,” mimeo, 2017.

Bruhn, Miriam and David McKenzie, “In Pursuit of Balance: Randomization in Practice in Development Field Experiments,” American Economic Journal: Applied Economics, 2009, 1 (4), 200–232.

Brunstein, Joachim C and Peter M Gollwitzer, “Effects of Failure on Subsequent Performance: The Importance of Self-Defining Goals,” Journal of Personality and Social Psychology, 1996, 70 (2), 395.

Cabrera, José María and Alejandro Cid, “Gender Differences to Relative Performance Feedback: A Field Experiment in Education,” mimeo, 2017.

Camerer, Colin F, Anna Dreber, Eskil Forsell, Teck-Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan et al., “Evaluating Replicability of Laboratory Experiments in Economics,” Science, 2016, 351 (6280), 1433–1436.

Card, David, Alexandre Mas, Enrico Moretti, and Emmanuel Saez, “Inequality at Work: The Effect of Peer Salaries on Job Satisfaction,” American Economic Review, 2012, 102 (6), 2981–3003.

Carrell, Scott E and James E West, “Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors,” Journal of Political Economy, 2010, 118 (3), 409–432.

Carrell, Scott E, Richard L Fullerton, and James E West, “Does Your Cohort Matter? Measuring Peer Effects in College Achievement,” Journal of Labor Economics, 2009, 27 (3), 439–464.

Castleman, Benjamin L and Lindsay C Page, “Summer Nudging: Can Personalized Text Messages and Peer Mentor Outreach Increase College Going Among Low-Income High School Graduates?,” Journal of Economic Behavior & Organization, 2015, 115, 144–160.

Castleman, Benjamin L and Lindsay C Page, “Freshman Year Financial Aid Nudges: An Experiment to Increase FAFSA Renewal and College Persistence,” Journal of Human Resources, 2016, 51 (2), 389–415.

Charness, Gary, David Masclet, and Marie Claire Villeval, “The Dark Side of Competition for Status,” Management Science, 2013, 60 (1), 38–55.

Chetty, Raj, “Behavioral Economics and Public Policy: A Pragmatic Perspective,” American Economic Review, 2015, 105 (5), 1–33.

Cialdini, Robert B, “Crafting Normative Messages to Protect the Environment,” Current Directions in Psychological Science, 2003, 12 (4), 105–109.

Cialdini, Robert B, “The Focus Theory of Normative Conduct,” Handbook of Theories of Social Psychology, 2011, 2, 295–312.

Cialdini, Robert B, Linda J Demaine, Brad J Sagarin, Daniel W Barrett, Kelton Rhoads, and Patricia L Winter, “Managing Social Norms for Persuasive Impact,” Social Influence, 2006, 1 (1), 3–15.

Cialdini, Robert B, Raymond R Reno, and Carl A Kallgren, “A Focus Theory of Normative Conduct: Recycling the Concept of Norms to Reduce Littering in Public Places,” Journal of Personality and Social Psychology, 1990, 58 (6), 1015–1026.

Compte, Olivier and Andrew Postlewaite, “Confidence-Enhanced Performance,” American Economic Review, 2004, 94 (5), 1536–1557.

Corcoran, K., J. Crusius, and T. Mussweiler, “Social Comparison: Motives, Standards, and Mechanisms,” in Derek Chadee, ed., Theories in Social Psychology, Wiley-Blackwell, 2011.

Costa, Dora L and Matthew E Kahn, “Energy Conservation “Nudges” and Environmentalist Ideology: Evidence from a Randomized Residential Electricity Field Experiment,” Journal of the European Economic Association, 2013, 11 (3), 680–702.

Damgaard, Mette Trier and Helena Skyt Nielsen, “Nudging in Education,” Economics of Education Review, 2018, forthcoming.

Danzer, Natalia and Victor Lavy, “Paid Parental Leave and Children’s Schooling Outcomes,” The Economic Journal, 2018, 128 (608), 81–117.

Delfgaauw, Josse, Robert Dur, Joeri Sol, and Willem Verbeke, “Tournament Incentives in the Field: Gender Differences in the Workplace,” Journal of Labor Economics, 2013, 31 (2), 305–326.

Deutsch, Morton and Harold B Gerard, “A Study of Normative and Informational Social Influences upon Individual Judgment,” The Journal of Abnormal and Social Psychology, 1955, 51 (3), 629.

Dobkin, Carlos, Ricard Gil, and Justin Marion, “Skipping Class in College and Exam Performance: Evidence from a Regression Discontinuity Classroom Experiment,” Economics of Education Review, 2010, 29 (4), 566–575.

Dustmann, Christian and Uta Schönberg, “Expansions in Maternity Leave Coverage and Children’s Long-Term Outcomes,” American Economic Journal: Applied Economics, 2012, 4 (3), 190–224.

Duvendack, Maren, Richard Palmer-Jones, and W Robert Reed, “What Is Meant by "Replication" and Why Does It Encounter Resistance in Economics?,” American Economic Review, 2017, 107 (5), 46–51.

Eil, David and Justin M Rao, “The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself,” American Economic Journal: Microeconomics, 2011, 3 (2), 114–138.

Eriksson, Tor, Anders Poulsen, and Marie Claire Villeval, “Feedback and Incentives: Experimental Evidence,” Labour Economics, 2009, 16 (6), 679–688.

Ertac, Seda, “Social Comparisons and Optimal Information Revelation: Theory and Experiments,” Job Market Paper, UCLA, 2005.

Festinger, Leon, “A Theory of Social Comparison Processes,” Human Relations, 1954, 7 (2), 117–140.

Fischer, Mira and Valentin Wagner, “Effects of Timing and Reference Frame of Feedback: Evidence from a Field Experiment in Secondary Schools,” mimeo, 2017.

Garibaldi, Pietro, Francesco Giavazzi, Andrea Ichino, and Enrico Rettore, “College Cost and Time to Complete a Degree: Evidence from Tuition Discontinuities,” Review of Economics and Statistics, 2012, 94 (3), 699–711.

Gibbons, Robert and Kevin J Murphy, “Relative Performance Evaluation for Chief Executive Officers,” ILR Review, 1990, 43 (3), 30–S.

Gill, David, Zdenka Kissová, Jaesun Lee, and Victoria Prowse, “First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision,” Management Science, 2018, forthcoming.

Goldstein, Noah J, Robert B Cialdini, and Vladas Griskevicius, “A Room With a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels,” Journal of Consumer Research, 2008, 35 (3), 472–482.

Golman, Russell, David Hagmann, and George Loewenstein, “Information Avoidance,” Journal of Economic Literature, 2017, 55 (1), 96–135.

Goulas, Sofoklis and Rigissa Megalokonomou, “Knowing Who You Are: The Effect of Feedback Information on Short and Long Term Outcomes,” Warwick Economics Research Paper Series 1075, 2015.

Grossman, Zachary and David Owens, “An Unlucky Feeling: Overconfidence and Noisy Feedback,” Journal of Economic Behavior & Organization, 2012, 84 (2), 510–524.

Hallsworth, Michael, John A List, Robert D Metcalfe, and Ivo Vlaev, “The Behavioralist as Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance,” Journal of Public Economics, 2017, 148, 14–31.

Hertwig, Ralph and Christoph Engel, “Homo Ignorans: Deliberately Choosing Not to Know,” Perspectives on Psychological Science, 2016, 11 (3), 359–372.

Himmler, Oliver, Robert Jäckle, and Philipp Weinschenk, “Soft Commitments, Reminders and Academic Performance,” American Economic Journal: Applied Economics, forthcoming.

Hoxby, Caroline and Sarah Turner, “Expanding College Opportunities for High-Achieving, Low Income Students,” SIEPR Discussion Paper 12-014, 2013.

Ilgen, Daniel and Cori Davis, “Bearing Bad News: Reactions to Negative Performance Feedback,” Applied Psychology, 2000, 49 (3), 550–565.

Ilgen, Daniel R, Cynthia D Fisher, and M Susan Taylor, “Consequences of Individual Feedback on Behavior in Organizations.,” Journal of Applied Psychology, 1979, 64 (4), 349.

Kajitani, Shinya, Keiichi Morimoto, and Shiba Suzuki, “Relative Performance Information Feedback and Just-Pass Behavior: Evidence from a Field Experiment,” Meisei University Working Papers 36, 2017.

Kandel, Eugene and Edward P Lazear, “Peer Pressure and Partnerships,” Journal of Political Economy, 1992, 100 (4), 801–817.

Katreniakova, Dagmara, “Social Comparison, Rewards and Incentives to Learn: A Randomized Control Trial in Uganda,” mimeo, 2014.

Köszegi, Botond, “Ego Utility, Overconfidence, and Task Choice,” Journal of the European Economic Association, 2006, 4 (4), 673–707.

Kuhnen, Camelia M and Agnieszka Tymula, “Feedback, Self-Esteem, and Performance in Organizations,” Management Science, 2012, 58 (1), 94–113.

Lee, David S, “Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects,” The Review of Economic Studies, 2009, 76 (3), 1071–1102.

Lee, David S and Thomas Lemieux, “Regression Discontinuity Designs in Economics,” Journal of Economic Literature, 2010, 48 (2), 281–355.

Leuven, Edwin, Hessel Oosterbeek, and Bas Klaauw, “The Effect of Financial Rewards on Students’ Achievement: Evidence from a Randomized Experiment,” Journal of the European Economic Association, 2010, 8 (6), 1243–1265.

Madrian, Brigitte C, “Applying Insights from Behavioral Economics to Policy Design,” Annual Review of Economics, 2014, 6 (1), 663–688.

Möbius, Markus M, Muriel Niederle, Paul Niehaus, and Tanya S Rosenblat, “Managing Self-Confidence,” mimeo, 2014.

Morgan, Kari Lock and Donald B Rubin, “Rerandomization to Improve Covariate Balance in Experiments,” The Annals of Statistics, 2012, 40 (2), 1263–1282.

OECD, “Education at a Glance 2013: OECD Indicators,” Technical Report, OECD Publishing 2013.

Open Science Collaboration, “Estimating the Reproducibility of Psychological Science,” Science, 2015, 349 (6251), aac4716.

Paola, Maria De, Vincenzo Scoppa, and Rosanna Nisticò, “Monetary Incentives and Student Achievement in a Depressed Labor Market: Results from a Randomized Experiment,” Journal of Human Capital, 2012, 6 (1), 56–85.

Pearce, Jone L and Lyman W Porter, “Employee Responses to Formal Performance Appraisal Feedback.,” Journal of Applied Psychology, 1986, 71 (2), 211.

Pikulina, Elena, Renneboog Luc, and Tobler N Philippe, “Do Confident Individuals Generally Work Harder?,” Journal of Multinational Financial Management, 2018, 44, 51–60.

Puri, Manju and David T Robinson, “Optimism and Economic Choice,” Journal of Financial Economics, 2007, 86 (1), 71–99.

Schultz, P Wesley, Jessica M Nolan, Robert B Cialdini, Noah J Goldstein, and Vladas Griskevicius, “The Constructive, Destructive, and Reconstructive Power of Social Norms,” Psychological Science, 2007, 18 (5), 429–434.

Slemrod, Joel, “Tax Compliance and Enforcement: New Research and its Policy Implications,” Ross School of Business Working Paper 1302, 2016.

Suls, Jerry and Ladd Wheeler, Handbook of Social Comparison: Theory and Research The Plenum Series in Social/Clinical Psychology, New York: Kluwer Academic/Plenum Publishers, 2000.

Sweeny, Kate, Darya Melnyk, Wendi Miller, and James A Shepperd, “Information Avoidance: Who, What, When, and Why,” Review of General Psychology, 2010, 14 (4), 340.

Taylor, S.E., H.A. Wayment, and M. Carrillo, “Social Comparison, Self-Regulation, and Motivation,” in R. M. Sorrentino and E.T. Higgins, eds., Handbook of Motivation and Cognition, Vol. 3. The Interpersonal Context, Guilford Press, 1996.

Tran, Anh and Richard Zeckhauser, “Rank as an Inherent Incentive: Evidence from a Field Experiment,” Journal of Public Economics, 2012, 96 (9), 645–650.

Trope, Yaacov and Nira Liberman, “Construal-Level Theory of Psychological Distance,” Psychological Review, 2010, 117 (2), 440.

Wiswall, Matthew and Basit Zafar, “Determinants of College Major Choice: Identification using an Information Experiment,” The Review of Economic Studies, 2015, 82 (2), 791–824.

Wiswall, Matthew and Basit Zafar, “How Do College Students Respond to Public Information about Earnings?,” Journal of Human Capital, 2015, 9 (2), 117–169.

Wood, Joanne V, “Theory and Research Concerning Social Comparisons of Personal Attributes.,” Psychological Bulletin, 1989, 106 (2), 231.