Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial

Tom Heyman; Ekaterina Pronizius; Savannah C Lewis; Oguz A Acar; Matúš Adamkovič; Ettore Ambrosini; Jan Antfolk; Krystian Barzykowski; Ernest Baskin; Carlota Batres; Leanne Boucher; Jordane Boudesseul; Eduard Brandstätter; W Matthew Collins; Dušica Filipović Ðurđević; Ciara Egan; Vanessa Era; Paulo Ferreira; Chiara Fini; Patricia Garrido-Vásquez; Hendrik Godbersen; Pablo Gomez; Aurelien Graton; Necdet Gurkan; Zhiran He; Dave C Johnson; Pavol Kačmár; Chris Koch; Marta Kowal; Tomas Kratochvil; Marco Marelli; Fernando Marmolejo-Ramos; Martín Martínez; Alan Mattiassi; Nicholas P Maxwell; Maria Montefinese; Coby Morvinski; Maital Neta; Yngwie A Nielsen; Sebastian Ocklenburg; Jaš Onič; Marietta Papadatou-Pastou; Adam J Parker; Mariola Paruzel-Czachura; Yuri G Pavlov; Manuel Perea; Gerit Pfuhl; Tanja C Roembke; Jan P Röer; Timo B Roettger; Susana Ruiz-Fernandez; Kathleen Schmidt; Cynthia S Q Siew; Christian K Tamnes; Jack E Taylor; Rémi Thériault; José L Ulloa; Miguel A Vadillo; Michael E W Varnum; Martin R Vasilev; Steven Verheyen; Giada Viviani; Sebastian Wallot; Yuki Yamada; Yueyuan Zheng; Erin M Buchanan

doi:10.1037/met0000770

Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial

Tom Heyman
, Ekaterina Pronizius
, Savannah C Lewis
, Oguz A Acar
, Matúš Adamkovič
, Ettore Ambrosini
, Jan Antfolk
, Krystian Barzykowski
, Ernest Baskin
, Carlota Batres
, Leanne Boucher
, Jordane Boudesseul
, Eduard Brandstätter
, W Matthew Collins
, Dušica Filipović Ðurđević
, Ciara Egan
, Vanessa Era
, Paulo Ferreira
, Chiara Fini
, Patricia Garrido-Vásquez

Hendrik Godbersen, Pablo Gomez, Aurelien Graton, Necdet Gurkan, Zhiran He, Dave C Johnson, Pavol Kačmár, Chris Koch, Marta Kowal, Tomas Kratochvil, Marco Marelli, Fernando Marmolejo-Ramos, Martín Martínez, Alan Mattiassi, Nicholas P Maxwell, Maria Montefinese, Coby Morvinski, Maital Neta, Yngwie A Nielsen, Sebastian Ocklenburg, Jaš Onič, Marietta Papadatou-Pastou, Adam J Parker, Mariola Paruzel-Czachura, Yuri G Pavlov, Manuel Perea, Gerit Pfuhl, Tanja C Roembke, Jan P Röer, Timo B Roettger, Susana Ruiz-Fernandez, Kathleen Schmidt, Cynthia S Q Siew, Christian K Tamnes, Jack E Taylor, Rémi Thériault, José L Ulloa, Miguel A Vadillo, Michael E W Varnum, Martin R Vasilev, Steven Verheyen, Giada Viviani, Sebastian Wallot, Yuki Yamada, Yueyuan Zheng, Erin M Buchanan

Department of Economic Psychology

Research output: Contribution to journal › Article › peer-review

Original language	English
Journal	Psychological Methods
Early online date	18 Sept 2025
DOIs	https://doi.org/10.1037/met0000770
Publication status	Published - 2025

Fields of science

501021 Social psychology
501002 Applied psychology
605004 Cultural studies
501006 Experimental psychology
502045 Behavioural economics
501 Psychology
509017 Social studies of science
501029 Economic psychology

JKU Focus areas

Sustainable Development: Responsible Technologies and Management

Access to Document

10.1037/met0000770

Cite this

Heyman, T., Pronizius, E., Lewis, S. C., Acar, O. A., Adamkovič, M., Ambrosini, E., Antfolk, J., Barzykowski, K., Baskin, E., Batres, C., Boucher, L., Boudesseul, J., Brandstätter, E., Collins, W. M., Filipović Ðurđević, D., Egan, C., Era, V., Ferreira, P., Fini, C., ... Buchanan, E. M. (2025). Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial. Psychological Methods. https://doi.org/10.1037/met0000770

@article{9fcb5b7e23264f9da7608b7526d2e512,

title = "Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial",

author = "Tom Heyman and Ekaterina Pronizius and Lewis, \{Savannah C\} and Acar, \{Oguz A\} and Mat{\'u}{\v s} Adamkovi{\v c} and Ettore Ambrosini and Jan Antfolk and Krystian Barzykowski and Ernest Baskin and Carlota Batres and Leanne Boucher and Jordane Boudesseul and Eduard Brandst{\"a}tter and Collins, \{W Matthew\} and \{Filipovi{\'c} {\DH}ur{\d}evi{\'c}\}, Du{\v s}ica and Ciara Egan and Vanessa Era and Paulo Ferreira and Chiara Fini and Patricia Garrido-V{\'a}squez and Hendrik Godbersen and Pablo Gomez and Aurelien Graton and Necdet Gurkan and Zhiran He and Johnson, \{Dave C\} and Pavol Ka{\v c}m{\'a}r and Chris Koch and Marta Kowal and Tomas Kratochvil and Marco Marelli and Fernando Marmolejo-Ramos and Mart{\'i}n Mart{\'i}nez and Alan Mattiassi and Maxwell, \{Nicholas P\} and Maria Montefinese and Coby Morvinski and Maital Neta and Nielsen, \{Yngwie A\} and Sebastian Ocklenburg and Ja{\v s} Oni{\v c} and Marietta Papadatou-Pastou and Parker, \{Adam J\} and Mariola Paruzel-Czachura and Pavlov, \{Yuri G\} and Manuel Perea and Gerit Pfuhl and Roembke, \{Tanja C\} and R{\"o}er, \{Jan P\} and Roettger, \{Timo B\} and Susana Ruiz-Fernandez and Kathleen Schmidt and Siew, \{Cynthia S Q\} and Tamnes, \{Christian K\} and Taylor, \{Jack E\} and R{\'e}mi Th{\'e}riault and Ulloa, \{Jos{\'e} L\} and Vadillo, \{Miguel A\} and Varnum, \{Michael E W\} and Vasilev, \{Martin R\} and Steven Verheyen and Giada Viviani and Sebastian Wallot and Yuki Yamada and Yueyuan Zheng and Buchanan, \{Erin M\}",

year = "2025",

doi = "10.1037/met0000770",

language = "English",

journal = "Psychological Methods",

issn = "1082-989X",

}

Heyman, T, Pronizius, E, Lewis, SC, Acar, OA, Adamkovič, M, Ambrosini, E, Antfolk, J, Barzykowski, K, Baskin, E, Batres, C, Boucher, L, Boudesseul, J, Brandstätter, E, Collins, WM, Filipović Ðurđević, D, Egan, C, Era, V, Ferreira, P, Fini, C, Garrido-Vásquez, P, Godbersen, H, Gomez, P, Graton, A, Gurkan, N, He, Z, Johnson, DC, Kačmár, P, Koch, C, Kowal, M, Kratochvil, T, Marelli, M, Marmolejo-Ramos, F, Martínez, M, Mattiassi, A, Maxwell, NP, Montefinese, M, Morvinski, C, Neta, M, Nielsen, YA, Ocklenburg, S, Onič, J, Papadatou-Pastou, M, Parker, AJ, Paruzel-Czachura, M, Pavlov, YG, Perea, M, Pfuhl, G, Roembke, TC, Röer, JP, Roettger, TB, Ruiz-Fernandez, S, Schmidt, K, Siew, CSQ, Tamnes, CK, Taylor, JE, Thériault, R, Ulloa, JL, Vadillo, MA, Varnum, MEW, Vasilev, MR, Verheyen, S, Viviani, G, Wallot, S, Yamada, Y, Zheng, Y & Buchanan, EM 2025, 'Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial', Psychological Methods. https://doi.org/10.1037/met0000770

TY - JOUR

T1 - Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions

T2 - A tutorial

AU - Heyman, Tom

AU - Pronizius, Ekaterina

AU - Lewis, Savannah C

AU - Acar, Oguz A

AU - Adamkovič, Matúš

AU - Ambrosini, Ettore

AU - Antfolk, Jan

AU - Barzykowski, Krystian

AU - Baskin, Ernest

AU - Batres, Carlota

AU - Boucher, Leanne

AU - Boudesseul, Jordane

AU - Brandstätter, Eduard

AU - Collins, W Matthew

AU - Filipović Ðurđević, Dušica

AU - Egan, Ciara

AU - Era, Vanessa

AU - Ferreira, Paulo

AU - Fini, Chiara

AU - Garrido-Vásquez, Patricia

AU - Godbersen, Hendrik

AU - Gomez, Pablo

AU - Graton, Aurelien

AU - Gurkan, Necdet

AU - He, Zhiran

AU - Johnson, Dave C

AU - Kačmár, Pavol

AU - Koch, Chris

AU - Kowal, Marta

AU - Kratochvil, Tomas

AU - Marelli, Marco

AU - Marmolejo-Ramos, Fernando

AU - Martínez, Martín

AU - Mattiassi, Alan

AU - Maxwell, Nicholas P

AU - Montefinese, Maria

AU - Morvinski, Coby

AU - Neta, Maital

AU - Nielsen, Yngwie A

AU - Ocklenburg, Sebastian

AU - Onič, Jaš

AU - Papadatou-Pastou, Marietta

AU - Parker, Adam J

AU - Paruzel-Czachura, Mariola

AU - Pavlov, Yuri G

AU - Perea, Manuel

AU - Pfuhl, Gerit

AU - Roembke, Tanja C

AU - Röer, Jan P

AU - Roettger, Timo B

AU - Ruiz-Fernandez, Susana

AU - Schmidt, Kathleen

AU - Siew, Cynthia S Q

AU - Tamnes, Christian K

AU - Taylor, Jack E

AU - Thériault, Rémi

AU - Ulloa, José L

AU - Vadillo, Miguel A

AU - Varnum, Michael E W

AU - Vasilev, Martin R

AU - Verheyen, Steven

AU - Viviani, Giada

AU - Wallot, Sebastian

AU - Yamada, Yuki

AU - Zheng, Yueyuan

AU - Buchanan, Erin M

PY - 2025

Y1 - 2025

U2 - 10.1037/met0000770

DO - 10.1037/met0000770

M3 - Article

C2 - 40965962

SN - 1082-989X

JO - Psychological Methods

JF - Psychological Methods

ER -