Munich Personal RePEc Archive

Evaluating replicability of laboratory experiments in Economics

Camerer, Colin and Dreber, Anna and Forsell, Eskil and Ho, Teck-Hua and Huber, Jurgen and Johannesson, Magnus and Kirchler, Michael and Almenberg, Johan and Altmejd, Adam and Chan, Taizan and Heikensten, Emma and Holzmeister, Felix and Imai, Taisuke and Isaksson, Siri and Nave, Gideon and Pfeiffer, Thomas and Razen, Michael and Wu, Hang (2016): Evaluating replicability of laboratory experiments in Economics. Published in: Science , Vol. 351, No. 6277 (3 March 2016)

[img]
Preview
PDF
MPRA_paper_75461.pdf

Download (1MB) | Preview

Abstract

The reproducibility of scientific findings has been called into question. To contribute data about reproducibility in economics, we replicate 18 studies published in the American Economic Review and the Quarterly Journal of Economics in 2011-2014. All replications follow predefined analysis plans publicly posted prior to the replications, and have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We find a significant effect in the same direction as the original study for 11 replications (61%); on average the replicated effect size is 66% of the original. The reproducibility rate varies between 67% and 78% for four additional reproducibility indicators, including a prediction market measure of peer beliefs.

UB_LMU-Logo
MPRA is a RePEc service hosted by
the Munich University Library in Germany.