Many Labs 5: Registered Replication of Payne, Burkley, and Stokes (2008), Study 4

Charles R. Ebersole; Luca Andrighetto; Erica Casini; Carlo Chiorri; Anna Dalla Rosa; Filippo Domaneschi; Ian R. Ferguson; Emily Fryberger; Mauro Giacomantonio; Jon E. Grahe; Jennifer A. Joy-Gaba; Eleanor V. Langford; Austin Lee Nichols; Angelo Panno; Kimberly P. Parks; Emanuele Preti; Juliette Richetin; Michelangelo Vianello

doi:10.1177/2515245919885609

Many Labs 5: Registered Replication of Payne, Burkley, and Stokes (2008), Study 4

Charles R. Ebersole^*, Luca Andrighetto, Erica Casini, Carlo Chiorri, Anna Dalla Rosa, Filippo Domaneschi, Ian R. Ferguson, Emily Fryberger, Mauro Giacomantonio, Jon E. Grahe, Jennifer A. Joy-Gaba, Eleanor V. Langford, Austin Lee Nichols, Angelo Panno, Kimberly P. Parks, Emanuele Preti, Juliette Richetin, Michelangelo Vianello

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

Abstract (may include machine translation)

To rule out an alternative to their structural-fit hypothesis, Payne, Burkley, and Stokes (2008) demonstrated that correlations between implicit and explicit race attitudes were weaker when participants were put under high pressure to respond without bias than when they were placed under low pressure. This effect was replicated in Italy by Vianello (2015), although the replication effect was smaller than the original effect. In the current investigation, we examined the possibility that the source of a study’s sample moderates this effect. Teams from eight universities, four in the United States and four in Italy, replicated the original study (replication N = 1,103). Although we did detect moderation by the sample’s country, it was due to a reversal of the original effect in the United States and a lack of the original effect in Italy. We discuss this curious finding and possible explanations.

Original language	English
Pages (from-to)	387-393
Number of pages	7
Journal	Advances in Methods and Practices in Psychological Science
Volume	3
Issue number	3
DOIs	https://doi.org/10.1177/2515245919885609
State	Published - Sep 2020
Externally published	Yes

Keywords

attitudes
direct replication
open data
open materials
preregistered
reproducibility

Access to Document

10.1177/2515245919885609

https://iris.unige.it/bitstream/11567/1072732/1/10.1177%402515245919885609.pdf

Cite this

Ebersole, C. R., Andrighetto, L., Casini, E., Chiorri, C., Dalla Rosa, A., Domaneschi, F., Ferguson, I. R., Fryberger, E., Giacomantonio, M., Grahe, J. E., Joy-Gaba, J. A., Langford, E. V., Nichols, A. L., Panno, A., Parks, K. P., Preti, E., Richetin, J., & Vianello, M. (2020). Many Labs 5: Registered Replication of Payne, Burkley, and Stokes (2008), Study 4. Advances in Methods and Practices in Psychological Science, 3(3), 387-393. https://doi.org/10.1177/2515245919885609

@article{9be7cc1d3f4643b3942ca1ade7b5a569,

title = "Many Labs 5: Registered Replication of Payne, Burkley, and Stokes (2008), Study 4",

abstract = "To rule out an alternative to their structural-fit hypothesis, Payne, Burkley, and Stokes (2008) demonstrated that correlations between implicit and explicit race attitudes were weaker when participants were put under high pressure to respond without bias than when they were placed under low pressure. This effect was replicated in Italy by Vianello (2015), although the replication effect was smaller than the original effect. In the current investigation, we examined the possibility that the source of a study{\textquoteright}s sample moderates this effect. Teams from eight universities, four in the United States and four in Italy, replicated the original study (replication N = 1,103). Although we did detect moderation by the sample{\textquoteright}s country, it was due to a reversal of the original effect in the United States and a lack of the original effect in Italy. We discuss this curious finding and possible explanations.",

keywords = "attitudes, direct replication, open data, open materials, preregistered, reproducibility",

author = "Ebersole, {Charles R.} and Luca Andrighetto and Erica Casini and Carlo Chiorri and {Dalla Rosa}, Anna and Filippo Domaneschi and Ferguson, {Ian R.} and Emily Fryberger and Mauro Giacomantonio and Grahe, {Jon E.} and Joy-Gaba, {Jennifer A.} and Langford, {Eleanor V.} and Nichols, {Austin Lee} and Angelo Panno and Parks, {Kimberly P.} and Emanuele Preti and Juliette Richetin and Michelangelo Vianello",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2020.",

year = "2020",

month = sep,

doi = "10.1177/2515245919885609",

language = "English",

volume = "3",

pages = "387--393",

journal = "Advances in Methods and Practices in Psychological Science",

issn = "2515-2459",

number = "3",

}

Ebersole, CR, Andrighetto, L, Casini, E, Chiorri, C, Dalla Rosa, A, Domaneschi, F, Ferguson, IR, Fryberger, E, Giacomantonio, M, Grahe, JE, Joy-Gaba, JA, Langford, EV, Nichols, AL, Panno, A, Parks, KP, Preti, E, Richetin, J & Vianello, M 2020, 'Many Labs 5: Registered Replication of Payne, Burkley, and Stokes (2008), Study 4', Advances in Methods and Practices in Psychological Science, vol. 3, no. 3, pp. 387-393. https://doi.org/10.1177/2515245919885609

TY - JOUR

T1 - Many Labs 5

T2 - Registered Replication of Payne, Burkley, and Stokes (2008), Study 4

AU - Ebersole, Charles R.

AU - Andrighetto, Luca

AU - Casini, Erica

AU - Chiorri, Carlo

AU - Dalla Rosa, Anna

AU - Domaneschi, Filippo

AU - Ferguson, Ian R.

AU - Fryberger, Emily

AU - Giacomantonio, Mauro

AU - Grahe, Jon E.

AU - Joy-Gaba, Jennifer A.

AU - Langford, Eleanor V.

AU - Nichols, Austin Lee

AU - Panno, Angelo

AU - Parks, Kimberly P.

AU - Preti, Emanuele

AU - Richetin, Juliette

AU - Vianello, Michelangelo

PY - 2020/9

Y1 - 2020/9

N2 - To rule out an alternative to their structural-fit hypothesis, Payne, Burkley, and Stokes (2008) demonstrated that correlations between implicit and explicit race attitudes were weaker when participants were put under high pressure to respond without bias than when they were placed under low pressure. This effect was replicated in Italy by Vianello (2015), although the replication effect was smaller than the original effect. In the current investigation, we examined the possibility that the source of a study’s sample moderates this effect. Teams from eight universities, four in the United States and four in Italy, replicated the original study (replication N = 1,103). Although we did detect moderation by the sample’s country, it was due to a reversal of the original effect in the United States and a lack of the original effect in Italy. We discuss this curious finding and possible explanations.

AB - To rule out an alternative to their structural-fit hypothesis, Payne, Burkley, and Stokes (2008) demonstrated that correlations between implicit and explicit race attitudes were weaker when participants were put under high pressure to respond without bias than when they were placed under low pressure. This effect was replicated in Italy by Vianello (2015), although the replication effect was smaller than the original effect. In the current investigation, we examined the possibility that the source of a study’s sample moderates this effect. Teams from eight universities, four in the United States and four in Italy, replicated the original study (replication N = 1,103). Although we did detect moderation by the sample’s country, it was due to a reversal of the original effect in the United States and a lack of the original effect in Italy. We discuss this curious finding and possible explanations.

KW - attitudes

KW - direct replication

KW - open data

KW - open materials

KW - preregistered

KW - reproducibility

UR - http://www.scopus.com/inward/record.url?scp=85106649856&partnerID=8YFLogxK

U2 - 10.1177/2515245919885609

DO - 10.1177/2515245919885609

M3 - Article

AN - SCOPUS:85106649856

SN - 2515-2459

VL - 3

SP - 387

EP - 393

JO - Advances in Methods and Practices in Psychological Science

JF - Advances in Methods and Practices in Psychological Science

IS - 3

ER -

Many Labs 5: Registered Replication of Payne, Burkley, and Stokes (2008), Study 4

Abstract (may include machine translation)

Keywords

Access to Document

Other files and links

Fingerprint

Cite this