Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.

Saved in:
Bibliographic Details
Title: Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.
Authors: Heyman T; Methodology and Statistics Unit, Institute of Psychology, Leiden University., Pronizius E; Department of Cognition, Emotion, and Methods in Psychology, University of Vienna., Lewis SC; Department of Psychology, University of Alabama., Acar OA; King's Business School, King's College London., Adamkovič M; Institute of Social Sciences, CSPS, Slovak Academy of Sciences., Ambrosini E; Department of Neuroscience, Padova Neuroscience Center, University of Padova., Antfolk J; Faculty of Arts, Psychology and Theology, Abo Akademi University., Barzykowski K; Institute of Psychology, Faculty of Philosophy, Jagiellonian University., Baskin E; Department of Food, Pharma, and Healthcare, Saint Joseph's University., Batres C; Department of Psychology, Franklin and Marshall College., Boucher L; Department of Psychology and Neuroscience, Nova Southeastern University., Boudesseul J; Laboratoire Parisien de Psychologie Sociale, Universite Paris Nanterre., Brandstätter E; Department of Economic Psychology, Johannes Kepler University Linz., Collins WM; Department of Psychology and Neuroscience, Nova Southeastern University., Filipović Ðurđević D; Department of Psychology, Faculty of Philosophy, University of Belgrade., Egan C; School of Psychology, University of Galway., Era V; Department of Psychology, Sapienza University of Rome., Ferreira P; Instituto de Psicologia, Universidade Federal de Uberlandia., Fini C; Department of Dynamic and Clinical Psychology and Health Studies, Sapienza University of Rome., Garrido-Vásquez P; Department of Psychology, University of Concepcion., Godbersen H; FOM University of Applied Sciences., Gomez P; California State University-San Bernardino., Graton A; Laboratoire de Psychologie Sociale, Universite Paris Cite., Gurkan N; University of Missouri-St. Louis., He Z; Education Department, Henan University., Johnson DC; York College, City University of New York., Kačmár P; Department of Psychology, Faculty of Arts, Pavol Jozef Safarik University in Kosice., Koch C; Department of Psychology, George Fox University., Kowal M; IDN Being Human, Institute of Psychology, University of Wroclaw., Kratochvil T; Interdisciplinary Research Team on Internet and Society, Faculty of Social Studies, Masaryk University., Marelli M; Department of Psychology, University of Milano-Bicocca., Marmolejo-Ramos F; College of Education, Psychology, and Social Work, Flinders University., Martínez M; Department of Psychology, University of Navarra., Mattiassi A; Department of Education, Literatures, Intercultural Studies, Languages and Psychology, University of Florence., Maxwell NP; Department of Psychology, Midwestern State University., Montefinese M; Department of Developmental Psychology and Socialisation, University of Padova., Morvinski C; Department of Management, Ben-Gurion University of the Negev., Neta M; Department of Psychology, Center for Brain, Biology, and Behavior, University of Nebraska-Lincoln., Nielsen YA; School of Communication and Culture, Aarhus University., Ocklenburg S; Department of Psychology, Medical School Hamburg (MSH)., Onič J; Department of Comparative and General Linguistics, Faculty of Arts, University of Ljubljana., Papadatou-Pastou M; Department of Primary Education, National and Kapodistrian University of Athens., Parker AJ; Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London., Paruzel-Czachura M; Institute of Psychology, University of Silesia in Katowice., Pavlov YG; Institute of Medical Psychology and Behavioral Neurobiology, University of Tuebingen., Perea M; Department of Methodology, Universitat de Valencia., Pfuhl G; Department of Psychology, Norwegian University of Science and Technology., Roembke TC; Institute of Psychology, RWTH Aachen University., Röer JP; Department of Psychology and Psychotherapy, Witten/Herdecke University., Roettger TB; Department of Linguistics and Scandinavian Studies, University of Oslo., Ruiz-Fernandez S; Department of Psychology, Brandenburg University of Technology Cottbus-Senftenberg., Schmidt K; Department of Psychology, Ashland University., Siew CSQ; Department of Psychology, Faculty of Arts and Social Sciences, National University of Singapore., Tamnes CK; Department of Psychology, University of Oslo., Taylor JE; Department of Psychology, Goethe University Frankfurt., Thériault R; Department of Psychology, Universite du Quebec a Montreal., Ulloa JL; Programa de Investigacion Asociativa (PIA) en Ciencias Cognitivas, Centro de Investigacion en Ciencias Cognitivas (CICC), Facultad de Psicologia, Universidad de Talca., Vadillo MA; Department of Basic Psychology, Universidad Autonoma de Madrid., Varnum MEW; Department of Psychology, Arizona State University., Vasilev MR; Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London., Verheyen S; Department of Psychology, Education and Child Studies, Erasmus University Rotterdam., Viviani G; Department of Developmental Psychology and Socialisation, University of Padova., Wallot S; Institute for Sustainability Psychology, Leuphana University of Luneburg., Yamada Y; Faculty of Arts and Science, Kyushu University., Zheng Y; Division of Social Science, Hong Kong University of Science and Technology., Buchanan EM; Analytics Program, Harrisburg University of Science and Technology.
Source: Psychological methods [Psychol Methods] 2025 Sep 18. Date of Electronic Publication: 2025 Sep 18.
Publication Type: Journal Article
Journal Info: Publisher: American Psychological Association Country of Publication: United States NLM ID: 9606928 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1939-1463 (Electronic) Linking ISSN: 1082989X NLM ISO Abbreviation: Psychol Methods Subsets: MEDLINE
Database: MEDLINE Ultimate
FullText Text:
  Availability: 0
Header DbId: mdl
DbLabel: MEDLINE Ultimate
An: 40965962
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Heyman+T%22">Heyman T</searchLink>; Methodology and Statistics Unit, Institute of Psychology, Leiden University.<br /><searchLink fieldCode="AU" term="%22Pronizius+E%22">Pronizius E</searchLink>; Department of Cognition, Emotion, and Methods in Psychology, University of Vienna.<br /><searchLink fieldCode="AU" term="%22Lewis+SC%22">Lewis SC</searchLink>; Department of Psychology, University of Alabama.<br /><searchLink fieldCode="AU" term="%22Acar+OA%22">Acar OA</searchLink>; King's Business School, King's College London.<br /><searchLink fieldCode="AU" term="%22Adamkovič+M%22">Adamkovič M</searchLink>; Institute of Social Sciences, CSPS, Slovak Academy of Sciences.<br /><searchLink fieldCode="AU" term="%22Ambrosini+E%22">Ambrosini E</searchLink>; Department of Neuroscience, Padova Neuroscience Center, University of Padova.<br /><searchLink fieldCode="AU" term="%22Antfolk+J%22">Antfolk J</searchLink>; Faculty of Arts, Psychology and Theology, Abo Akademi University.<br /><searchLink fieldCode="AU" term="%22Barzykowski+K%22">Barzykowski K</searchLink>; Institute of Psychology, Faculty of Philosophy, Jagiellonian University.<br /><searchLink fieldCode="AU" term="%22Baskin+E%22">Baskin E</searchLink>; Department of Food, Pharma, and Healthcare, Saint Joseph's University.<br /><searchLink fieldCode="AU" term="%22Batres+C%22">Batres C</searchLink>; Department of Psychology, Franklin and Marshall College.<br /><searchLink fieldCode="AU" term="%22Boucher+L%22">Boucher L</searchLink>; Department of Psychology and Neuroscience, Nova Southeastern University.<br /><searchLink fieldCode="AU" term="%22Boudesseul+J%22">Boudesseul J</searchLink>; Laboratoire Parisien de Psychologie Sociale, Universite Paris Nanterre.<br /><searchLink fieldCode="AU" term="%22Brandstätter+E%22">Brandstätter E</searchLink>; Department of Economic Psychology, Johannes Kepler University Linz.<br /><searchLink fieldCode="AU" term="%22Collins+WM%22">Collins WM</searchLink>; Department of Psychology and Neuroscience, Nova Southeastern University.<br /><searchLink fieldCode="AU" term="%22Filipović+Ðurđević+D%22">Filipović Ðurđević D</searchLink>; Department of Psychology, Faculty of Philosophy, University of Belgrade.<br /><searchLink fieldCode="AU" term="%22Egan+C%22">Egan C</searchLink>; School of Psychology, University of Galway.<br /><searchLink fieldCode="AU" term="%22Era+V%22">Era V</searchLink>; Department of Psychology, Sapienza University of Rome.<br /><searchLink fieldCode="AU" term="%22Ferreira+P%22">Ferreira P</searchLink>; Instituto de Psicologia, Universidade Federal de Uberlandia.<br /><searchLink fieldCode="AU" term="%22Fini+C%22">Fini C</searchLink>; Department of Dynamic and Clinical Psychology and Health Studies, Sapienza University of Rome.<br /><searchLink fieldCode="AU" term="%22Garrido-Vásquez+P%22">Garrido-Vásquez P</searchLink>; Department of Psychology, University of Concepcion.<br /><searchLink fieldCode="AU" term="%22Godbersen+H%22">Godbersen H</searchLink>; FOM University of Applied Sciences.<br /><searchLink fieldCode="AU" term="%22Gomez+P%22">Gomez P</searchLink>; California State University-San Bernardino.<br /><searchLink fieldCode="AU" term="%22Graton+A%22">Graton A</searchLink>; Laboratoire de Psychologie Sociale, Universite Paris Cite.<br /><searchLink fieldCode="AU" term="%22Gurkan+N%22">Gurkan N</searchLink>; University of Missouri-St. Louis.<br /><searchLink fieldCode="AU" term="%22He+Z%22">He Z</searchLink>; Education Department, Henan University.<br /><searchLink fieldCode="AU" term="%22Johnson+DC%22">Johnson DC</searchLink>; York College, City University of New York.<br /><searchLink fieldCode="AU" term="%22Kačmár+P%22">Kačmár P</searchLink>; Department of Psychology, Faculty of Arts, Pavol Jozef Safarik University in Kosice.<br /><searchLink fieldCode="AU" term="%22Koch+C%22">Koch C</searchLink>; Department of Psychology, George Fox University.<br /><searchLink fieldCode="AU" term="%22Kowal+M%22">Kowal M</searchLink>; IDN Being Human, Institute of Psychology, University of Wroclaw.<br /><searchLink fieldCode="AU" term="%22Kratochvil+T%22">Kratochvil T</searchLink>; Interdisciplinary Research Team on Internet and Society, Faculty of Social Studies, Masaryk University.<br /><searchLink fieldCode="AU" term="%22Marelli+M%22">Marelli M</searchLink>; Department of Psychology, University of Milano-Bicocca.<br /><searchLink fieldCode="AU" term="%22Marmolejo-Ramos+F%22">Marmolejo-Ramos F</searchLink>; College of Education, Psychology, and Social Work, Flinders University.<br /><searchLink fieldCode="AU" term="%22Martínez+M%22">Martínez M</searchLink>; Department of Psychology, University of Navarra.<br /><searchLink fieldCode="AU" term="%22Mattiassi+A%22">Mattiassi A</searchLink>; Department of Education, Literatures, Intercultural Studies, Languages and Psychology, University of Florence.<br /><searchLink fieldCode="AU" term="%22Maxwell+NP%22">Maxwell NP</searchLink>; Department of Psychology, Midwestern State University.<br /><searchLink fieldCode="AU" term="%22Montefinese+M%22">Montefinese M</searchLink>; Department of Developmental Psychology and Socialisation, University of Padova.<br /><searchLink fieldCode="AU" term="%22Morvinski+C%22">Morvinski C</searchLink>; Department of Management, Ben-Gurion University of the Negev.<br /><searchLink fieldCode="AU" term="%22Neta+M%22">Neta M</searchLink>; Department of Psychology, Center for Brain, Biology, and Behavior, University of Nebraska-Lincoln.<br /><searchLink fieldCode="AU" term="%22Nielsen+YA%22">Nielsen YA</searchLink>; School of Communication and Culture, Aarhus University.<br /><searchLink fieldCode="AU" term="%22Ocklenburg+S%22">Ocklenburg S</searchLink>; Department of Psychology, Medical School Hamburg (MSH).<br /><searchLink fieldCode="AU" term="%22Onič+J%22">Onič J</searchLink>; Department of Comparative and General Linguistics, Faculty of Arts, University of Ljubljana.<br /><searchLink fieldCode="AU" term="%22Papadatou-Pastou+M%22">Papadatou-Pastou M</searchLink>; Department of Primary Education, National and Kapodistrian University of Athens.<br /><searchLink fieldCode="AU" term="%22Parker+AJ%22">Parker AJ</searchLink>; Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London.<br /><searchLink fieldCode="AU" term="%22Paruzel-Czachura+M%22">Paruzel-Czachura M</searchLink>; Institute of Psychology, University of Silesia in Katowice.<br /><searchLink fieldCode="AU" term="%22Pavlov+YG%22">Pavlov YG</searchLink>; Institute of Medical Psychology and Behavioral Neurobiology, University of Tuebingen.<br /><searchLink fieldCode="AU" term="%22Perea+M%22">Perea M</searchLink>; Department of Methodology, Universitat de Valencia.<br /><searchLink fieldCode="AU" term="%22Pfuhl+G%22">Pfuhl G</searchLink>; Department of Psychology, Norwegian University of Science and Technology.<br /><searchLink fieldCode="AU" term="%22Roembke+TC%22">Roembke TC</searchLink>; Institute of Psychology, RWTH Aachen University.<br /><searchLink fieldCode="AU" term="%22Röer+JP%22">Röer JP</searchLink>; Department of Psychology and Psychotherapy, Witten/Herdecke University.<br /><searchLink fieldCode="AU" term="%22Roettger+TB%22">Roettger TB</searchLink>; Department of Linguistics and Scandinavian Studies, University of Oslo.<br /><searchLink fieldCode="AU" term="%22Ruiz-Fernandez+S%22">Ruiz-Fernandez S</searchLink>; Department of Psychology, Brandenburg University of Technology Cottbus-Senftenberg.<br /><searchLink fieldCode="AU" term="%22Schmidt+K%22">Schmidt K</searchLink>; Department of Psychology, Ashland University.<br /><searchLink fieldCode="AU" term="%22Siew+CSQ%22">Siew CSQ</searchLink>; Department of Psychology, Faculty of Arts and Social Sciences, National University of Singapore.<br /><searchLink fieldCode="AU" term="%22Tamnes+CK%22">Tamnes CK</searchLink>; Department of Psychology, University of Oslo.<br /><searchLink fieldCode="AU" term="%22Taylor+JE%22">Taylor JE</searchLink>; Department of Psychology, Goethe University Frankfurt.<br /><searchLink fieldCode="AU" term="%22Thériault+R%22">Thériault R</searchLink>; Department of Psychology, Universite du Quebec a Montreal.<br /><searchLink fieldCode="AU" term="%22Ulloa+JL%22">Ulloa JL</searchLink>; Programa de Investigacion Asociativa (PIA) en Ciencias Cognitivas, Centro de Investigacion en Ciencias Cognitivas (CICC), Facultad de Psicologia, Universidad de Talca.<br /><searchLink fieldCode="AU" term="%22Vadillo+MA%22">Vadillo MA</searchLink>; Department of Basic Psychology, Universidad Autonoma de Madrid.<br /><searchLink fieldCode="AU" term="%22Varnum+MEW%22">Varnum MEW</searchLink>; Department of Psychology, Arizona State University.<br /><searchLink fieldCode="AU" term="%22Vasilev+MR%22">Vasilev MR</searchLink>; Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London.<br /><searchLink fieldCode="AU" term="%22Verheyen+S%22">Verheyen S</searchLink>; Department of Psychology, Education and Child Studies, Erasmus University Rotterdam.<br /><searchLink fieldCode="AU" term="%22Viviani+G%22">Viviani G</searchLink>; Department of Developmental Psychology and Socialisation, University of Padova.<br /><searchLink fieldCode="AU" term="%22Wallot+S%22">Wallot S</searchLink>; Institute for Sustainability Psychology, Leuphana University of Luneburg.<br /><searchLink fieldCode="AU" term="%22Yamada+Y%22">Yamada Y</searchLink>; Faculty of Arts and Science, Kyushu University.<br /><searchLink fieldCode="AU" term="%22Zheng+Y%22">Zheng Y</searchLink>; Division of Social Science, Hong Kong University of Science and Technology.<br /><searchLink fieldCode="AU" term="%22Buchanan+EM%22">Buchanan EM</searchLink>; Analytics Program, Harrisburg University of Science and Technology.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%229606928%22">Psychological methods</searchLink> [Psychol Methods] 2025 Sep 18. <i>Date of Electronic Publication: </i>2025 Sep 18.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22American+Psychological+Association%22">American Psychological Association </searchLink><i>Country of Publication: </i>United States <i>NLM ID: </i>9606928 <i>Publication Model: </i>Print-Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>1939-1463 (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%221082989X%22">1082989X </searchLink><i>NLM ISO Abbreviation: </i>Psychol Methods <i>Subsets: </i>MEDLINE
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=mdl&AN=40965962
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1037/met0000770
    Languages:
      – Code: eng
        Text: English
    Titles:
      – TitleFull: Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Heyman T
      – PersonEntity:
          Name:
            NameFull: Pronizius E
      – PersonEntity:
          Name:
            NameFull: Lewis SC
      – PersonEntity:
          Name:
            NameFull: Acar OA
      – PersonEntity:
          Name:
            NameFull: Adamkovič M
      – PersonEntity:
          Name:
            NameFull: Ambrosini E
      – PersonEntity:
          Name:
            NameFull: Antfolk J
      – PersonEntity:
          Name:
            NameFull: Barzykowski K
      – PersonEntity:
          Name:
            NameFull: Baskin E
      – PersonEntity:
          Name:
            NameFull: Batres C
      – PersonEntity:
          Name:
            NameFull: Boucher L
      – PersonEntity:
          Name:
            NameFull: Boudesseul J
      – PersonEntity:
          Name:
            NameFull: Brandstätter E
      – PersonEntity:
          Name:
            NameFull: Collins WM
      – PersonEntity:
          Name:
            NameFull: Filipović Ðurđević D
      – PersonEntity:
          Name:
            NameFull: Egan C
      – PersonEntity:
          Name:
            NameFull: Era V
      – PersonEntity:
          Name:
            NameFull: Ferreira P
      – PersonEntity:
          Name:
            NameFull: Fini C
      – PersonEntity:
          Name:
            NameFull: Garrido-Vásquez P
      – PersonEntity:
          Name:
            NameFull: Godbersen H
      – PersonEntity:
          Name:
            NameFull: Gomez P
      – PersonEntity:
          Name:
            NameFull: Graton A
      – PersonEntity:
          Name:
            NameFull: Gurkan N
      – PersonEntity:
          Name:
            NameFull: He Z
      – PersonEntity:
          Name:
            NameFull: Johnson DC
      – PersonEntity:
          Name:
            NameFull: Kačmár P
      – PersonEntity:
          Name:
            NameFull: Koch C
      – PersonEntity:
          Name:
            NameFull: Kowal M
      – PersonEntity:
          Name:
            NameFull: Kratochvil T
      – PersonEntity:
          Name:
            NameFull: Marelli M
      – PersonEntity:
          Name:
            NameFull: Marmolejo-Ramos F
      – PersonEntity:
          Name:
            NameFull: Martínez M
      – PersonEntity:
          Name:
            NameFull: Mattiassi A
      – PersonEntity:
          Name:
            NameFull: Maxwell NP
      – PersonEntity:
          Name:
            NameFull: Montefinese M
      – PersonEntity:
          Name:
            NameFull: Morvinski C
      – PersonEntity:
          Name:
            NameFull: Neta M
      – PersonEntity:
          Name:
            NameFull: Nielsen YA
      – PersonEntity:
          Name:
            NameFull: Ocklenburg S
      – PersonEntity:
          Name:
            NameFull: Onič J
      – PersonEntity:
          Name:
            NameFull: Papadatou-Pastou M
      – PersonEntity:
          Name:
            NameFull: Parker AJ
      – PersonEntity:
          Name:
            NameFull: Paruzel-Czachura M
      – PersonEntity:
          Name:
            NameFull: Pavlov YG
      – PersonEntity:
          Name:
            NameFull: Perea M
      – PersonEntity:
          Name:
            NameFull: Pfuhl G
      – PersonEntity:
          Name:
            NameFull: Roembke TC
      – PersonEntity:
          Name:
            NameFull: Röer JP
      – PersonEntity:
          Name:
            NameFull: Roettger TB
      – PersonEntity:
          Name:
            NameFull: Ruiz-Fernandez S
      – PersonEntity:
          Name:
            NameFull: Schmidt K
      – PersonEntity:
          Name:
            NameFull: Siew CSQ
      – PersonEntity:
          Name:
            NameFull: Tamnes CK
      – PersonEntity:
          Name:
            NameFull: Taylor JE
      – PersonEntity:
          Name:
            NameFull: Thériault R
      – PersonEntity:
          Name:
            NameFull: Ulloa JL
      – PersonEntity:
          Name:
            NameFull: Vadillo MA
      – PersonEntity:
          Name:
            NameFull: Varnum MEW
      – PersonEntity:
          Name:
            NameFull: Vasilev MR
      – PersonEntity:
          Name:
            NameFull: Verheyen S
      – PersonEntity:
          Name:
            NameFull: Viviani G
      – PersonEntity:
          Name:
            NameFull: Wallot S
      – PersonEntity:
          Name:
            NameFull: Yamada Y
      – PersonEntity:
          Name:
            NameFull: Zheng Y
      – PersonEntity:
          Name:
            NameFull: Buchanan EM
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 18
              M: 09
              Text: 2025 Sep 18
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 1939-1463
          Titles:
            – TitleFull: Psychological methods
              Type: main
ResultId 1