Same data, different conclusions: Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis

Martin Schweinsberg, Michael Feldman, Nicola Staub, Olmo R. van den Akker, Robbie C. M. van Aert, Marcel A. L. M. van Assen, Yang Liu, Tim Althoff, Jeffrey Heer, Alex Kale, Zainab Mohamed, Hashem Amireh, Vaishali Venkatesh Prasad, Abraham Bernstein, Emily Robinson, Kaisa Snellman, S. Amy Sommer, Sarah M. G. Otner, David Robinson, Nikhil MadanRaphael Silberzahn, Pavel Goldstein, Warren Tierney, Toshio Murase, Benjamin Mandl, Domenico Viganola, Carolin Strobl, Catherine B. C. Schaumans, Stijn Kelchtermans, Chan Naseeb, S. Mason Garrison, Tal Yarkoni, C. S. Richard Chan, Prestone Adie, Paulius Alaburda, Casper Albers, Sara Alspaugh, Jeff Alstott, Andrew A. Nelson, Eduardo Arinno de la Rubia, Adbi Arzi, Stepan Bahnik, Jason Baik, Laura Winther Balling, Sachin Banker, David A. A. Baranger, Dale J. Barr, Brenda Barros-Rivera, Matt Bauer, Enuh Blaise

Research output: Contribution to journalArticlepeer-review

Original languageEnglish
Pages (from-to)228-249
Number of pages22
JournalOrganizational Behavior and Human Decision Processes
Volume165
DOIs
StatePublished - Jul 2021

Keywords

  • Analysis-contingent results
  • Crowdsourcing data analysis
  • Research reliability
  • Researcher degrees of freedom
  • Scientific robustness
  • Scientific transparency

Cite this