Social Information and Educational Investment - Nudging Remedial Math Course Participation

Brade, Raphael (2022): Social Information and Educational Investment - Nudging Remedial Math Course Participation.

Abstract

Using randomized field experiments, I investigate the effectiveness of two social information interventions at increasing participation in a voluntary remedial math course for university students. In Intervention 1, incoming students receive invitation letters with information about the course sign-up rate in a previous semester. In Intervention 2, the students who signed up for the course receive reminder letters that include information on how helpful the course has been evaluated by previous students. On average, neither intervention increases participation in the course, but further analyses reveal that the effects of Intervention 1 are heterogeneous along two dimensions: First, by increasing the salience of the course, it raises attendance among students who enroll late in their study program, which in turn increases their first-year performance and closes the achievement gap to early enrollees. Second, the effect of the information about the past sign-up rate depends on the predicted ex-ante sign-up probability. Students for whom the prediction falls just short of the past sign-up rate increase sign-up and participation, while the opposite is true for students whose sign-up probability exceeds the social information. Along this dimension, however, the changes in attendance do not carry over to academic achievements.

• Item Type: MPRA Paper
• Language: English
• Keywords: Social Information; Higher Education; Randomized Field Experiment; Remedial Courses
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C93 - Field Experiments; D - Microeconomics > D8 - Information, Knowledge, and Uncertainty > D83 - Search ; Learning ; Information and Knowledge ; Communication ; Belief ; Unawareness; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I21 - Analysis of Education; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I23 - Higher Education ; Research Institutions

References

Abadie, Alberto, Matthew M. Chingos, and Martin R. West. 2018. “Endogenous Stratification in Randomized Experiments.” Review of Economics and Statistics, 100(4): 567–580.

Allcott, Hunt. 2011. “Social Norms and Energy Conservation.” Journal of Public Economics, 95(9): 1082–1095.

Allcott, Hunt, and Todd Rogers. 2014. “The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation.” American Economic Review, 104(10): 3003–3037.

Altonji, Joseph G. 1993. “The Demand for and Return to Education When Education Outcomes are Uncertain.” Journal of Labor Economics, 11(1): 48–83.

Altonji, Joseph G., Erica Blom, and Costas Meghir. 2012. “Heterogeneity in Human Capital Investments: High School Curriculum, College Major, and Careers.” Annual Review of Economics, 4(1): 185–223.

Anderson, Michael L. 2008. “Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects.” Journal of the American Statistical Association, 103(484): 1481–1495.

Azmat, Ghazala, Manuel Bagues, Antonio Cabrales, and Nagore Iriberri. 2019. “What You Don’t Know. . . Can’t Hurt You? A Natural Field Experiment on Relative Performance Feedback in Higher Education.” Management Science, 65(8): 3449–3947.

Belloni, Alexandre, Victor Chernozhukov, and Christian Hansen. 2014. “Inference on Treatment Effects after Selection among High-Dimensional Controls.” Review of Economic Studies, 81(2): 608–650.

Bergman, Peter, Jeffrey T. Denning, and Dayanand Manoli. 2019. “Is Information Enough? The Effect of Information about Education Tax Benefits on Student Outcomes.” Journal of Policy Analysis and Management, 38(3): 706–731.

Bicchieri, Cristina, and Eugen Dimant. 2019. “Nudging With Care: The Risks and Benefits of Social Information.” Public Choice.

Bird, Kelli A., Benjamin L. Castleman, Jeffrey T. Denning, Joshua Goodman, Cait Lamberton, and Kelly Ochs Rosinger. 2021. “Nudging at Scale: Experimental Evidence from FAFSA Completion Campaigns.” Journal of Economic Behavior & Organization, 183: 105–128.

Bleemer, Zachary, and Basit Zafar. 2018. “Intended College Attendance: Evidence from an Experiment on College Returns and Costs.” Journal of Public Economics, 157: 184–211.

Boatman, Angela, and Bridget Terry Long. 2018. “Does Remediation Work for All Students? How the Effects of Postsecondary Remedial and Developmental Courses Vary by Level of Academic Preparation.” Educational Evaluation and Policy Analysis, 40(1): 29–58.

Brade, Raphael, Oliver Himmler, and Robert Jäckle. 2021. “Relative Performance Feedback and the Effects of Being Above Average – Field Experiment and Replication.” mimeo.

Brent, Daniel A., Corey Lott, Michael Taylor, Joseph Cook, Kimberly Rollins, and Shawn Stoddard. 2020. “What Causes Heterogeneous Responses to Social Comparison Messages for Water Conservation?” Environmental and Resource Economics, 1–35.

Bryan, Christopher J., Elizabeth Tipton, and David S. Yeager. 2021. “Behavioural Science Is Unlikely to Change the World Without a Heterogeneity Revolution.” Nature Human Behaviour, 5(8): 980–989.

Büchele, Stefan. 2020a. “Bridging the Gap – How Effective Are Remedial Math Courses in Germany?” Studies in Educational Evaluation, 64: 100832.

Büchele, Stefan. 2020b. “Should We Trust Math Preparatory Courses? An Empirical Analysis on the Impact of Students’ Participation and Attendance on Short- and Medium-Term Effects.” Economic Analysis and Policy, 66: 154–167.

Burger, Jerry M., Christina T. LaSalvia, Lauren A. Hendricks, Tara Mehdipour, and Elise M. Neudeck. 2011. “Partying Before the Party Gets Started: The Effects of Descriptive Norms on Pregaming Behavior.” Basic and Applied Social Psychology, 33(3): 220–227.

Byrne, David P., Andrea La Nauze, and Leslie A. Martin. 2018. “Tell Me Something I Don’t Already Know: Informedness and the Impact of Information Programs.” Review of Economics and Statistics, 100(3): 510–527.

Cantoni, Davide, David Y. Yang, Noam Yuchtman, and Y. Jane Zhang. 2019. “Protests as Strategic Games: Experimental Evidence from Hong Kong’s Antiauthoritarian Movement.” Quarterly Journal of Economics, 134(2): 1021–1077.

Coffman, Lucas C., Clayton R. Featherstone, and Judd B. Kessler. 2017. “Can Social Information Affect What Job You Choose and Keep?” American Economic Journal: Applied Economics, 9(1): 96–117.

Coffman, Lucas, Clayton R. Featherstone, and Judd B. Kessler. 2015. “A Model of Information Nudges.” mimeo.

Croson, Rachel, and Jen Yue Shang. 2008. “The Impact of Downward Social Information on Contribution Decisions.” Experimental Economics, 11(3): 221–233.

Damgaard, Mette Trier, and Helena Skyt Nielsen. 2018. “Nudging in Education.” Economics of Education Review, 64: 313–342.

Darolia, Rajeev, and Casandra Harper. 2018. “Information Use and Attention Deferment in College Student Loan Decisions: Evidence From a Debt Letter Experiment.” Educational Evaluation and Policy Analysis, 40(1): 129–150.

Delavande, Adeline, and Basit Zafar. 2019. “University Choice: The Role of Expected Earnings, Nonpecuniary Outcomes, and Financial Constraints.” Journal of Political Economy, 127(5): 2343–2393.

DellaVigna, Stefano, and Elizabeth Linos. 2022. “RCTs to Scale: Comprehensive Evidence From Two Nudge Units.” Econometrica, 90(1): 81–116.

Doane, Ashley N., Michelle L. Kelley, and Matthew R. Pearson. 2016. “Reducing Cyberbullying: A Theory of Reasoned Action-Based Video Prevention Program for College Students.” Aggressive Behavior, 42(2): 136–146.

Dobrescu, Loretti Isabella, Marco Faravelli, Rigissa Megalokonomou, and Alberto Motta. 2021. “Relative Performance Feedback in Education: Evidence from a Randomised Controlled Trial.” Economic Journal, 131(640): 3145–3181.

Else-Quest, Nicole M, Janet Shibley Hyde, and Marcia C Linn. 2010. “Cross-National Patterns of Gender Differences in Mathematics: A Meta-Analysis.” Psychological Bulletin, 136(1): 103.

Fischbacher, Urs, Simon Gächter, and Ernst Fehr. 2001. “Are People Conditionally Cooperative? Evidence from a Public Goods Experiment.” Economics Letters, 71(3): 397–404.

French, Robert, and Philip Oreopoulos. 2017. “Behavioral Barriers Transitioning to College.” Labour Economics, 47: 48–63.

Frey, Bruno S., and Stephan Meier. 2004. “Social Comparisons and Pro-social Behavior: Testing “Conditional Cooperation” in a Field Experiment.” American Economic Review, 94(5): 1717–1722.

Gee, Laura K. 2019. “The More You Know: Information Effects on Job Application Rates in a Large Field Experiment.” Management Science, 65(5): 2077–2094.

Goldstein, Noah J., Robert B. Cialdini, and Vladas Griskevicius. 2008. “A Room With a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels.” Journal of Consumer Research, 35(3): 472–482.

Gurantz, Oded, Jessica Howell, Michael Hurwitz, Cassandra Larson, Matea Pender, and Brooke White. 2021. “A National-Level Informational Experiment to Promote Enrollment in Selective Colleges.” Journal of Policy Analysis and Management, 40(2): 453–479.

Hallsworth, Michael, John A. List, Robert D. Metcalfe, and Ivo Vlaev. 2017. “The Behavioralist as Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance.” Journal of Public Economics, 148: 14–31.

Holzer, Harry J., and Sandy Baum. 2017. Making College Work: Pathways to Success for Disadvantaged Students. Washington, DC:Brookings Institution.

Hout, Michael. 2012. “Social and Economic Returns to College Education in the United States.” Annual Review of Sociology, 38: 379–400.

Huang, Chiungjung. 2013. “Gender Differences in Academic Self-Efficacy: A Meta-Analysis.” European Journal of Psychology of Education, 28(1): 1–35.

Hummel, Dennis, and Alexander Maedche. 2019. “How Effective is Nudging? A Quantitative Review on the Effect Sizes and Limits of Empirical Nudging Studies.” Journal of Behavioral and Experimental Economics, 80: 47–58.

Huntington-Klein, Nick, and Andrew M. Gill. 2019. “An Informational Intervention to Increase Semester Credits in College.” Series of Unsurprising Results in Economics, 1: 1–17.

Jensen, Robert. 2010. “The (Perceived) Returns to Education and the Demand for Schooling.” Quarterly Journal of Economics, 125(2): 515–548.

Keser, Claudia, and Frans Van Winden. 2000. “Conditional Cooperation and Voluntary Contributions to Public Goods.” Scandinavian Journal of Economics, 102(1): 23–39.

Kim, Kyung Ryung, and Eun Hee Seo. 2015. “The Relationship Between Procrastination and Academic Performance: A Meta-Analysis.” Personality and Individual Differences, 82: 26–33.

Kraft, Matthew A. 2020. “Interpreting Effect Sizes of Education Interventions.” Educational Researcher, 49(4): 241–253.

Lapinski, Maria Knight, Erin K. Maloney, Mary Braz, and Hillary C. Shulman. 2013. “Testing the Effects of Social Norms and Behavioral Privacy on Hand Washing: A Field Experiment.” Human Communication Research, 39(1): 21–46.

Lergetporer, Philipp, Katharina Werner, and Ludger Woessmann. 2021. “Does Ignorance of Economic Returns and Costs Explain the Educational Aspiration Gap? Representative Evidence from Adults and Adolescents.” Economica, 88(351): 624–670.

Martin, Richard, and John Randal. 2008. “How is Donation Behaviour Affected by the Donations of Others?” Journal of Economic Behavior & Organization, 67(1): 228–238.

Martorell, Paco, and Isaac McFarlin Jr. 2011. “Help or Hindrance? The Effects of College Remediation on Academic and Labor Market Outcomes.” Review of Economics and Statistics, 93(2): 436–454.

Mertens, Stephanie, Mario Herberz, Ulf J.J. Hahnel, and Tobias Brosch. 2022. “The Effectiveness of Nudging: A Meta-Analysis of Choice Architecture Interventions across Behavioral Domains.” Proceedings of the National Academy of Sciences, 119(1).

Morgan, Kari Lock, and Donald B. Rubin. 2012. “Rerandomization to Improve Covariate Balance in Experiments.” Annals of Statistics, 40(2): 1263–1282.

Neckermann, Susanne, Uyanga Turmunkh, Dennie van Dolder, and Tong V. Wang. 2022. “Nudging Student Participation in Online Evaluations of Teaching: Evidence from a Field Experiment.” European Economic Review, 141: 104001.

Oreopoulos, Philip. 2021. “What Limits College Success? A Review and Further Analysis of Holzer and Baum’s Making College Work.” Journal of Economic Literature, 59(2): 546–73.

Oreopoulos, Philip, and Kjell G. Salvanes. 2011. “Priceless: The Nonpecuniary Benefits of Schooling.” Journal of Economic Perspectives, 25(1): 159–184.

Oreopoulos, Philip, and Uros Petronijevic. 2018. “Student Coaching: How Far Can Technology Go?” Journal of Human Resources, 53(2): 299–329.

Oreopoulos, Philip, and Uros Petronijevic. 2019. “The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It.” NBER Working Papers No. 26059.

Page, Lindsay C., Bruce Sacerdote, Sara Goldrick-Rab, and Ben Castleman. 2019. “Financial Aid Nudges: A National Experiment With Informational Interventions.” The Hope Center for College, Community, and Justice, Working Paper No. 3.

Perkins, H. Wesley. 2002. “Social Norms and the Prevention of Alcohol Misuse in Collegiate Contexts.” Journal of Studies on Alcohol, Supplement, s14: 164–172.

Rhodes, Nancy, Hillary C. Shulman, and Nikki McClaran. 2020. “Changing Norms: A Meta-Analytic Integration of Research on Social Norms Appeals.” Human Communication Research, 46(2-3): 161–191.

Schwab, Benjamin, Sarah Janzen, Nicholas P. Magnan, and William M. Thompson. 2020. “Constructing a Summary Index Using the Standardized Inverse-Covariance Weighted Average of Indicators.” Stata Journal, 20(4): 952–964.

Scott-Clayton, Judith, and Olga Rodriguez. 2015. “Development, Discouragement, or Diversion? New Evidence on the Effects of College Remediation Policy.” Education Finance and Policy, 10(1): 4–45.

Shang, Jen, and Rachel Croson. 2009. “A Field Experiment in Charitable Contribution: The Impact of Social Information on the Voluntary Provision of Public Goods.” Economic Journal, 119(540): 1422–1439.

Silva, Antonio, and Peter John. 2017. “Social Norms Don’t Always Work: An Experiment to Encourage More Efficient Fees Collection for Students.” PLoS ONE, 12(5): e0177354.

Smith, Jeffrey A. 2022. “Treatment Effect Heterogeneity.” IZA Discussion Papers No. 15151.

Spybrook, Jessaca, Howard Bloom, Richard Congdon, Carolyn Hill, Andres Martinez, and Stephen Raudenbush. 2011. “Optimal Design Plus Empirical Evidence: Documentation for the “Optimal Design” Software.” Optimal Design Plus Version 3.0.

Staneva, Mila. 2018. “Bachelor-Studierende mit Nebenjobs haben kaum schlechtere Noten, brauchen für ihr Studium aber etwas länger.” DIW Wochenbericht, 85(20): 433–442.

Tinto, Vincent. 1975. “Dropout from Higher Education: A Theoretical Synthesis of Recent Research.” Review of Educational Research, 45(1): 89–125.

Tinto, Vincent. 1993. Leaving College: Rethinking the Causes and Cures of Student Attrition. . 2nd ed., Chicago, IL:University of Chicago Press.

Turetsky, Kate M., and Catherine A. Sanderson. 2018. “Comparing Educational Interventions: Correcting Misperceived Norms Improves College Students’ Mental Health Attitudes.” Journal of Applied Social Psychology, 48(1): 46–55.

Turner, James, H. Wesley Perkins, and Jennifer Bauerle. 2008. “Declining Negative Consequences Related to Alcohol Misuse Among Students Exposed to a Social Norms Marketing Intervention on a College Campus.” Journal of American College Health, 57(1): 85–94.

Voßkamp, Rainer, and Angela Laging. 2014. “Teilnahmeentscheidungen und Erfolg.” In Mathematische Vor- und Brückenkurse. , ed. Isabell Bausch, Rolf Biehler, Regina Bruder, Pascal R. Fischer, Reinhard Hochmuth, Wolfram Koepf, Stephan Schreiber and Thomas Wassong, 67–83. Wiesbaden:Springer.

Wiswall, Matthew, and Basit Zafar. 2015a. “Determinants of College Major Choice: Identification using an Information Experiment.” Review of Economic Studies, 82(2): 791–824.

Wiswall, Matthew, and Basit Zafar. 2015b. “How Do College Students Respond to Public Information about Earnings?” Journal of Human Capital, 9(2): 117–169.