View in EDS PDF Full Text

Evaluating replicability of laboratory experiments in economics.

Saved in:
Bibliographic Details
Title: Evaluating replicability of laboratory experiments in economics.
Authors: Camerer, Colin F., Dreber, Anna, Forsell, Eskil, Teck-Hua Ho, Huber, Jürgen, Johannesson, Magnus, Kirchler, Michael, Almenberg, Johan, Altmejd, Adam, Chan, Taizan, Heikensten, Emma, Holzmeister, Felix, Imai, Taisuke, Isaksson, Siri, Nave, Gideon, Pfeiffer, Thomas, Razen, Michael, Wu, Hang
Source: Science (pre-March 2025). 3/25/2016, Vol. 351 Issue 6280, p1433-1436. 4p.
Subjects: Replication (Experimental design), Laboratory experiments in economics, Economic statistics, Economics, Economic surveys, Belief & doubt, Prediction markets, Peers, Psychology, Charts, diagrams, etc.
Abstract: The replicability of some scientific findings has recently been called into question.To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level.We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs. [ABSTRACT FROM AUTHOR]
Copyright of Science (pre-March 2025) is the property of American Association for the Advancement of Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 114017553
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating replicability of laboratory experiments in economics.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Camerer%2C+Colin+F%2E%22">Camerer, Colin F.</searchLink><br /><searchLink fieldCode="AR" term="%22Dreber%2C+Anna%22">Dreber, Anna</searchLink><br /><searchLink fieldCode="AR" term="%22Forsell%2C+Eskil%22">Forsell, Eskil</searchLink><br /><searchLink fieldCode="AR" term="%22Teck-Hua+Ho%22">Teck-Hua Ho</searchLink><br /><searchLink fieldCode="AR" term="%22Huber%2C+Jürgen%22">Huber, Jürgen</searchLink><br /><searchLink fieldCode="AR" term="%22Johannesson%2C+Magnus%22">Johannesson, Magnus</searchLink><br /><searchLink fieldCode="AR" term="%22Kirchler%2C+Michael%22">Kirchler, Michael</searchLink><br /><searchLink fieldCode="AR" term="%22Almenberg%2C+Johan%22">Almenberg, Johan</searchLink><br /><searchLink fieldCode="AR" term="%22Altmejd%2C+Adam%22">Altmejd, Adam</searchLink><br /><searchLink fieldCode="AR" term="%22Chan%2C+Taizan%22">Chan, Taizan</searchLink><br /><searchLink fieldCode="AR" term="%22Heikensten%2C+Emma%22">Heikensten, Emma</searchLink><br /><searchLink fieldCode="AR" term="%22Holzmeister%2C+Felix%22">Holzmeister, Felix</searchLink><br /><searchLink fieldCode="AR" term="%22Imai%2C+Taisuke%22">Imai, Taisuke</searchLink><br /><searchLink fieldCode="AR" term="%22Isaksson%2C+Siri%22">Isaksson, Siri</searchLink><br /><searchLink fieldCode="AR" term="%22Nave%2C+Gideon%22">Nave, Gideon</searchLink><br /><searchLink fieldCode="AR" term="%22Pfeiffer%2C+Thomas%22">Pfeiffer, Thomas</searchLink><br /><searchLink fieldCode="AR" term="%22Razen%2C+Michael%22">Razen, Michael</searchLink><br /><searchLink fieldCode="AR" term="%22Wu%2C+Hang%22">Wu, Hang</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Science+%28pre-March+2025%29%22">Science (pre-March 2025)</searchLink>. 3/25/2016, Vol. 351 Issue 6280, p1433-1436. 4p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Replication+%28Experimental+design%29%22">Replication (Experimental design)</searchLink><br /><searchLink fieldCode="DE" term="%22Laboratory+experiments+in+economics%22">Laboratory experiments in economics</searchLink><br /><searchLink fieldCode="DE" term="%22Economic+statistics%22">Economic statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Economics%22">Economics</searchLink><br /><searchLink fieldCode="DE" term="%22Economic+surveys%22">Economic surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Belief+%26+doubt%22">Belief & doubt</searchLink><br /><searchLink fieldCode="DE" term="%22Prediction+markets%22">Prediction markets</searchLink><br /><searchLink fieldCode="DE" term="%22Peers%22">Peers</searchLink><br /><searchLink fieldCode="DE" term="%22Psychology%22">Psychology</searchLink><br /><searchLink fieldCode="DE" term="%22Charts%2C+diagrams%2C+etc%2E%22">Charts, diagrams, etc.</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The replicability of some scientific findings has recently been called into question.To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level.We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Science (pre-March 2025) is the property of American Association for the Advancement of Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=114017553
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1126/science.aaf0918
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 4
        StartPage: 1433
    Subjects:
      – SubjectFull: Replication (Experimental design)
        Type: general
      – SubjectFull: Laboratory experiments in economics
        Type: general
      – SubjectFull: Economic statistics
        Type: general
      – SubjectFull: Economics
        Type: general
      – SubjectFull: Economic surveys
        Type: general
      – SubjectFull: Belief & doubt
        Type: general
      – SubjectFull: Prediction markets
        Type: general
      – SubjectFull: Peers
        Type: general
      – SubjectFull: Psychology
        Type: general
      – SubjectFull: Charts, diagrams, etc.
        Type: general
    Titles:
      – TitleFull: Evaluating replicability of laboratory experiments in economics.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Camerer, Colin F.
      – PersonEntity:
          Name:
            NameFull: Dreber, Anna
      – PersonEntity:
          Name:
            NameFull: Forsell, Eskil
      – PersonEntity:
          Name:
            NameFull: Teck-Hua Ho
      – PersonEntity:
          Name:
            NameFull: Huber, Jürgen
      – PersonEntity:
          Name:
            NameFull: Johannesson, Magnus
      – PersonEntity:
          Name:
            NameFull: Kirchler, Michael
      – PersonEntity:
          Name:
            NameFull: Almenberg, Johan
      – PersonEntity:
          Name:
            NameFull: Altmejd, Adam
      – PersonEntity:
          Name:
            NameFull: Chan, Taizan
      – PersonEntity:
          Name:
            NameFull: Heikensten, Emma
      – PersonEntity:
          Name:
            NameFull: Holzmeister, Felix
      – PersonEntity:
          Name:
            NameFull: Imai, Taisuke
      – PersonEntity:
          Name:
            NameFull: Isaksson, Siri
      – PersonEntity:
          Name:
            NameFull: Nave, Gideon
      – PersonEntity:
          Name:
            NameFull: Pfeiffer, Thomas
      – PersonEntity:
          Name:
            NameFull: Razen, Michael
      – PersonEntity:
          Name:
            NameFull: Wu, Hang
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 25
              M: 03
              Text: 3/25/2016
              Type: published
              Y: 2016
          Identifiers:
            – Type: issn-print
              Value: 00368075
          Numbering:
            – Type: volume
              Value: 351
            – Type: issue
              Value: 6280
          Titles:
            – TitleFull: Science (pre-March 2025)
              Type: main
ResultId 1