Evaluating replicability of laboratory experiments in economics.

Saved in:

Bibliographic Details
Title:	Evaluating replicability of laboratory experiments in economics.
Authors:	Camerer, Colin F., Dreber, Anna, Forsell, Eskil, Teck-Hua Ho, Huber, Jürgen, Johannesson, Magnus, Kirchler, Michael, Almenberg, Johan, Altmejd, Adam, Chan, Taizan, Heikensten, Emma, Holzmeister, Felix, Imai, Taisuke, Isaksson, Siri, Nave, Gideon, Pfeiffer, Thomas, Razen, Michael, Wu, Hang
Source:	Science (pre-March 2025). 3/25/2016, Vol. 351 Issue 6280, p1433-1436. 4p.
Subjects:	Replication (Experimental design), Laboratory experiments in economics, Economic statistics, Economics, Economic surveys, Belief & doubt, Prediction markets, Peers, Psychology, Charts, diagrams, etc.
Abstract:	The replicability of some scientific findings has recently been called into question.To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level.We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs. [ABSTRACT FROM AUTHOR]
	Copyright of Science (pre-March 2025) is the property of American Association for the Advancement of Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Psychology and Behavioral Sciences Collection

Description
Abstract:	The replicability of some scientific findings has recently been called into question.To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level.We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs. [ABSTRACT FROM AUTHOR]
ISSN:	00368075
DOI:	10.1126/science.aaf0918