Are Public Schools Ready to Integrate Math Classes with Khan Academy?

Ferman, Bruno and Finamor, Lucas and Lima, Lycia (2019): Are Public Schools Ready to Integrate Math Classes with Khan Academy?

Abstract

We study the impacts of the program Khan Academy in Schools using a randomized control trial in Brazilian primary public schools. Once a week, teachers would take their students to the school's computer lab and teach using the Khan Academy platform, instead of their standard math classes. We find positive effects of the program on measures of attitudes towards math, which were not translated to a positive average treatment effect on students' math proficiency. We also explore treatment heterogeneity by quality of implementation, suggesting that the program can have positive effects when there are no infrastructure problems and when the implementation modality is based on one computer per student. These results highlight the implementation challenges associated with educational tech-interventions in developing countries.

• Item Type: MPRA Paper
• Language: English
• Keywords: Education technology, personalized learning, productivity in education, randomized control trial
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C93 - Field Experiments; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I21 - Analysis of Education; J - Labor and Demographic Economics > J2 - Demand and Supply of Labor > J24 - Human Capital ; Skills ; Occupational Choice ; Labor Productivity

References

Aiken Jr, L. R. and Dreger, R. M. (1961). The effect of attitudes on performance in mathematics. Journal of Educational Psychology, 52(1):19.

Banerjee, A. V., Cole, S., Duflo, E., and Linden, L. (2007). Remedying education: Evi- dence from two randomized experiments in india. The Quarterly Journal of Economics, 122(3):1235–1264.

Brito, M. R. F. (1998). Adaptação e validação de uma escala de atitudes em relação a matemática. Zetetike: Revista de Educação Matemática, 6(9).

Bulman, G. and Fairlie, R. W. (2016). Technology and education: Computers, software, and the internet. In Handbook of the Economics of Education, volume 5, pages 239–280. Elsevier.

Carrillo, P. E., Onofa, M., and Ponce, J. (2011). Information technology and student achievement: Evidence from a randomized experiment in ecuador.

Glewwe, P. and Muralidharan, K. (2016). Improving Education Outcomes in Developing Countries: Evidence, Knowledge Gaps, and Policy Implications, volume 5. Elsevier B.V., 1 edition.

Lai, F., Luo, R., Zhang, L., Huang, X., and Rozelle, S. (2015). Does computer-assisted learning improve learning outcomes? evidence from a randomized experiment in migrant schools in beijing. Economics of Education Review, 47:34–48.

Linden, L. L. (2008). Complement or substitute?: The effect of technology on student achievement in India. InfoDev Working Paper, Columbia University.

Mo, D., Zhang, L., Wang, J., Huang, W., Shi, Y., Boswell, M., and Rozelle, S. (2013). The persistence of gains in learning from computer assisted learning: Evidence from a randomized experiment in rural schools in shaanxi province. Technical report, REAP working paper.

Muralidharan, K., Singh, A., and Ganimian, A. J. (2019). Disrupting education? experi- mental evidence on technology-aided instruction in india. American Economic Review, 109(4):1426–60.

WorldBank (2018). World development report 2018 : Learning to realize education’s promise.

Yang, Y., Zhang, L., Zeng, J., Pang, X., Lai, F., and Rozelle, S. (2013). Computers and the academic performance of elementary school-aged girls in china’s poor communities. Computers & Education, 60(1):335–346.