Reproducibility Project

Contributors: Jeffrey R. Spies, Brian A. Nosek, Elizabeth Bartmess, Calvin Lai, Jeff Galak, Michael Cohn, Frank Farach, Anita Alexander, Anna van 't Veer, Casey Eggleston, Catherine Olsson, Colin Tucker Smith, Daniel Lakens, Elisa Maria Galliani, Elise Giammanco, Elizabeth Dunn, Elizabeth Gilbert, Etienne LeBel, Frank Bosco, Frank Renkewitz, Georg Jahn, Gillian Sandstrom, Giulio Costantini, Hayley Cleary, Heather Fuchs, James G. Field, Jenelle Feather, Jennifer Joy-Gaba, Jesse J. Chandler, Jesse Kluver, Joshua Carp, Joshua Foster, Joshua Hartshorne, Katherine Moore, Kristi Lemm, Kristin Lane, Marco Perugini, Michael Barnett-Cowan, Michael Frank, Michael May, Michelangelo Vianello, Min ha Lee, Monica Britos, Nina Strohminger, Rebecca S. Frazier, Rebecca Saxe, Roger Giner-Sorolla, Russ Clay, Sally Linkenauger, Sara Garcia, Stephanie Muller, Susann Fiedler, Thomas Talhelm, Tyler M. Miller, William B Simpson, William Johnston, Jeremy Gray, James A. Grange, Kate Ratliff, Dylan Selterman, Jesse Graham, Jin X. Goh, Mark Brandt, Michael Pitts, Sena Koleva, Shauna Gordon-McKeon, Kate Johnson, Matt Motyl, Sean Mackinnon, Lars Goellner, Vivien Estel, Marcus Munafo, Jamie DeCoster, Abraham M. Rutchick, Anna Dreber Almenberg, Magnus Johannesson, Anup Gampa, Melissa Lewis, Alexander A. Aarts, Heather Kappes, Johanna Cohoon, Leslie Cramblet Alvarez
Date Created: 2012/04/01 03:49 PM | Last Updated: 2013/05/22 06:18 PM

Overview

Do normative scientific practices and incentive structures produce a biased body of research evidence? The Reproducibility Project is the first known empirical effort to estimate the reproducibility of a sample of studies from the scientific literature. The project is a large-scale, open collaboration involving dozens of scientists from around the world.

The investigation is currently sampling from the 2008 issues of three prominent psychology journals - Journal ...

read more

  • Popular press stories

    Recent Activity
    05/03/13 01:51 PM
    Brian A. Nosek updated wiki page home to version 19
    05/03/13 01:27 PM
    Brian A. Nosek updated wiki page home to version 18
    05/03/13 01:27 PM
    Brian A. Nosek updated wiki page home to version 17
  • Replication of Janiszewski & Uy (2008, PS, Study 4b)

    Recent Activity
    10/06/12 02:50 AM
    Jesse J. Chandler updated wiki page home to version 2
    10/06/12 02:50 AM
    Jesse J. Chandler updated wiki page home to version 1
    10/06/12 02:36 AM
    Jesse J. Chandler updated wiki page home to version 3
  • Replication of Reynolds & Besner (2008, JEP:LMC, Study 5)

    Recent Activity
    11/12/12 10:08 PM
    Calvin Lai made node Dataset public
    11/12/12 10:08 PM
    Calvin Lai made node Study Materials public
    11/12/12 10:08 PM
    Calvin Lai made node Replication of Reynolds & Besner (2008, JEP:LMC, Study 5) public
  • Replication of Richeson & Trawalter (2008, PS, Study 1)

    Recent Activity
    10/30/12 09:25 PM
    Calvin Lai made node Dataset public
    10/30/12 09:25 PM
    Calvin Lai made node Study Materials public
    10/30/12 09:20 PM
    Calvin Lai made node Replication of Richeson & Trawalter (2008, PS, Study 1) public
  • Replication of Payne, Burkley & Stokes (2008, JPSP, Study 4)

    Recent Activity
    09/25/12 12:11 PM
    Michelangelo Vianello added file Payne_et_al._2008.JPSP.final.report.pdf to node Replication of Payne, Burkley & Stokes (2008, JPSP, Study 4)
    09/25/12 10:43 AM
    Michelangelo Vianello updated wiki page home to version 29
    09/25/12 10:42 AM
    Michelangelo Vianello updated file Smithson.ComputeCIaroundPartialRsquared.pdf in node Dataset
  • Replication of Dai, Wertenbroch, & Brendl (2008, PS, Study 1)

    Recent Activity
    10/24/12 06:34 PM
    Heather Fuchs updated wiki page home to version 1
    10/24/12 06:16 PM
    Heather Fuchs updated file Full_Report.pdf in node Replication of Dai, Wertenbroch, & Brendl (2008, PS, Study 1)
    10/24/12 06:14 PM
    Heather Fuchs updated wiki page home to version 1
  • Replication of Janssen and colleagues (2008, JEP:LMC, Study 1)

    Recent Activity
    11/26/12 03:45 PM
    Jeff Galak updated file Trial_information.xlsx in node Data
    11/26/12 03:44 PM
    Jeff Galak updated wiki page home to version 2
    11/26/12 03:42 PM
    Jeff Galak updated wiki page home to version 1
  • Independent Direct Replication #1 of Correll (2008, JPSP, Study 2)

  • Replication of Nairne, Pandeirada, & Thompson (2008, PS, Study 2)

    Recent Activity
    03/21/13 03:11 PM
    Frank Renkewitz created node Dataset
    03/13/13 05:46 PM
    Stephanie Muller made node Replication of Nairne, Pandeirada, & Thompson (2008, PS, Study 2) public
    03/13/13 05:45 PM
    Stephanie Muller updated wiki page home to version 9
  • Replication of Estes, Verges, & Barsalou (2008, PS, Study 1)

  • Replication of Pleskac (2008, JEP:LMC)

    Recent Activity
    08/16/12 07:22 PM
    Jeremy Gray made node Replication of Pleskac (2008, JEP:LMC) public
    08/16/12 07:20 PM
    Jeremy Gray created node Replication of Pleskac (2008, JEP:LMC)
  • Replication of Fischer et al. (2008, JPSP, Study 4)

    Recent Activity
    05/23/13 02:44 PM
    Kate Ratliff changed the title from Study Materials to Study Materials - Replication of Fischer et al. (2008, JPSP)
    05/23/13 02:44 PM
    Kate Ratliff changed the title from Dataset to Dataset - Replication of Fischer et al. (2008, JPSP)
    05/23/13 02:44 PM
    Kate Ratliff changed the title from Final Report to Final Report - Replication of Fischer et al. (2008, JPSP)
  • Replication of Epley, Akalis, Waytz & Cacioppo (2008, PS, Study 3)

    Recent Activity
    01/14/13 03:03 AM
    Gillian Sandstrom updated wiki page home to version 9
    01/14/13 03:00 AM
    Gillian Sandstrom updated file Epley_et_al_2008.PS.final.report.pdf in node Replication of Epley, Akalis, Waytz & Cacioppo (2008, PS, Study 3)
    01/14/13 02:58 AM
    Gillian Sandstrom updated wiki page home to version 8
  • Replication of Morrison & Miller (2008, JPSP, Study 3)

  • Replication of White (2008, JEP:LMC, Study 3)

    Recent Activity
    03/13/13 05:59 PM
    Stephanie Muller updated wiki page home to version 3
    03/13/13 05:58 PM
    Stephanie Muller updated wiki page home to version 2
    03/13/13 05:58 PM
    Stephanie Muller updated file Data_Replication_White_JEP2008.xlsx in node Replication of White (2008, JEP:LMC, Study 3)
  • Replication of Pacton & Perruchet (2008, JEP:LMC, Study 4b)

    Recent Activity
    12/03/12 12:28 PM
    Georg Jahn made node Study Materials public
    12/03/12 12:27 PM
    Georg Jahn made node Dataset public
    12/03/12 12:27 PM
    Georg Jahn made node Replication of Pacton & Perruchet (2008, JEP:LMC, Study 4b) public
  • Replication of (Elizabeth's test project)

    Recent Activity
    09/30/12 05:15 PM
    Elizabeth Bartmess made node Dataset public
    09/30/12 04:44 PM
    Elizabeth Bartmess added file eb_testfile.txt to node Dataset
    09/30/12 04:44 PM
    Elizabeth Bartmess updated file eb_testfile.txt in node Dataset
  • Replication of Sahakyan et al. (2008, JEP:LMC, Study 3)

    Recent Activity
    11/30/12 10:54 PM
    Susann Fiedler made node Replication of Sahakyan et al. (2008, JEP:LMC, Study 3) public
    11/30/12 10:54 PM
    Susann Fiedler updated wiki page home to version 2
    11/30/12 10:53 PM
    Susann Fiedler updated wiki page home to version 1
  • Replication of Fischer, Greitemeyer, & Frey (2008, JPSP, Study 2)

    Recent Activity
    01/16/13 01:40 PM
    Elisa Maria Galliani made node Study Materials public
    01/16/13 01:39 PM
    Elisa Maria Galliani made node Dataset public
    01/16/13 01:38 PM
    Elisa Maria Galliani updated wiki page home to version 2
  • Replication of Williams & Bargh (2008, PS, Study 4)

    Recent Activity
    04/11/13 07:20 PM
    Jennifer Joy-Gaba updated wiki page home to version 3
    11/27/12 04:56 PM
    Jennifer Joy-Gaba updated file JCC.ReplicationProject.docx in node Study Materials
    11/27/12 04:46 PM
    Jennifer Joy-Gaba updated wiki page home to version 2
  • Replication of Bressan & Stranieri (2008, PS, Study 3)

  • Replication of Vul et al (2008, PS, Study 1)

    Recent Activity
    03/21/13 09:00 PM
    Michael Barnett-Cowan made node Study Materials public
    03/21/13 09:00 PM
    Michael Barnett-Cowan updated file letter_information.pdf in node Study Materials
    03/21/13 09:00 PM
    Michael Barnett-Cowan updated file Reproducibility_consent_form.pdf in node Study Materials
  • Online Replication of Exline, Baumeister, Zell, Kraft, & Witvliet (2008, JPSP, Study 7)

    Recent Activity
    10/23/12 10:54 PM
    Elise Giammanco added Rebecca S. Frazier as contributor on node Study Materials
    10/23/12 10:54 PM
    Elise Giammanco added Rebecca S. Frazier as contributor on node Dataset
    10/23/12 10:54 PM
    Elise Giammanco created node Study Materials
  • Replication of Alter & Oppenheimmer (2008, PS, Study 2B)

    Recent Activity
    05/22/13 06:19 PM
    Joshua Foster added file Final_Writeup.docx to node Study Materials
    05/22/13 06:18 PM
    Joshua Foster updated wiki page home to version 17
    05/22/13 06:18 PM
    Joshua Foster updated wiki page home to version 4
  • Replication of Amodio, Devine, & Harmon-Jones (2008, JPSP, Study 2)

    Recent Activity
    10/25/12 08:54 PM
    Kate Johnson updated wiki page home to version 3
    10/25/12 08:50 PM
    Kate Johnson updated wiki page home to version 2
    10/25/12 08:45 PM
    Kate Johnson updated wiki page home to version 1
  • Replication of Hajcak & Foti (2008, PS, Study 1)

    Recent Activity
    10/31/12 06:53 PM
    Melissa Lewis created node Study Materials
    10/31/12 06:52 PM
    Melissa Lewis created node Study materials
    10/31/12 06:52 PM
    Melissa Lewis created node Dataset
  • Replication of Henderson, de Liver, & Gollwitzer (2008, JPSP, Study 5)

    Recent Activity
    11/03/12 05:42 AM
    Kristin Lane updated wiki page home to version 6
    11/03/12 05:41 AM
    Kristin Lane updated wiki page home to version 5
    11/03/12 05:40 AM
    Kristin Lane changed the title from Replication of Henderson, de Liver, & Gollwitzer (2008; JPSP, Study 5) to Replication of Henderson, de Liver, & Gollwitzer (2008, JPSP, Study 5)
  • Replication of Blankenship & Wegener (2008, JPSP, Study 5A)

    Recent Activity
    12/08/12 12:40 AM
    Kristi Lemm updated file Replication_of_Blankenship_and_Wegener_2008_JPSP_Study_5A.pdf in node Replication of Blankenship & Wegener (2008, JPSP, Study 5A)
    12/08/12 12:37 AM
    Kristi Lemm updated file Blankenship-Wegener_survey_materials_from_all_conditions.docx in node Study Materials
    12/08/12 12:35 AM
    Kristi Lemm created node Study Materials
  • Replication of Goschke & Dreisbach (2008, PS)

    Recent Activity
    11/26/12 03:28 PM
    Giulio Costantini made node Dataset public
    11/26/12 03:28 PM
    Giulio Costantini made node Study Materials public
    11/26/12 03:28 PM
    Giulio Costantini made node Replication of Goschke & Dreisbach (2008, PS) public
    • Reproducibility Project
      • Popular press stories
      • Replication of Janiszewski & Uy (2008, PS, Study 4b)
        • Final Report
        • Data
        • Study Materials
      • Replication of Reynolds & Besner (2008, JEP:LMC, Study 5)
        • Materials
        • Materials
        • Study Materials
        • Study Materials
        • Dataset
      • Replication of Richeson & Trawalter (2008, PS, Study 1)
        • Dataset
        • Study Materials
      • Replication of Richeson & Trawalter (2008, PS, Study 1, Web)
      • Replication of Richeson & Trawalter (2008, PS, Study 1, Lab)
        • Materials
        • Analysis Plan
      • Replication of Payne, Burkley & Stokes (2008, JPSP, Study 4)
        • Dataset
        • Study Materials
      • Replication of Dai, Wertenbroch, & Brendl (2008, PS, Study 1)
        • Dataset
        • Study Materials
      • Replication of Janssen and colleagues (2008, JEP:LMC, Study 1)
        • Data
        • Final Report
        • Study Materials
      • Independent Direct Replication #1 of Correll (2008, JPSP, Study 2)
      • Replication of Nairne, Pandeirada, & Thompson (2008, PS, Study 2)
        • Dataset
        • Dataset
      • Replication of Estes, Verges, & Barsalou (2008, PS, Study 1)
      • Replication of Pleskac (2008, JEP:LMC)
      • Replication of Fischer et al. (2008, JPSP, Study 4)
        • Study Materials - Replication of Fischer et al. (2008, JPSP)
        • Dataset - Replication of Fischer et al. (2008, JPSP)
        • Final Report - Replication of Fischer et al. (2008, JPSP)
      • Replication of Epley, Akalis, Waytz & Cacioppo (2008, PS, Study 3)
        • Dataset
        • Study Materials
      • Replication of Bressan & Stranieri (2008, PS, Study 3)
      • Replication of Morrison & Miller (2008, JPSP, Study 3)
      • Replication of White (2008, JEP:LMC, Study 3)
      • Replication of Pacton & Perruchet (2008, JEP:LMC, Study 4b)
        • Dataset
        • Study Materials
        • Study Materials
      • Replication of (Elizabeth's test project)
        • Dataset
        • Study Materials
      • Replication of Sahakyan et al. (2008, JEP:LMC, Study 3)
      • Replication of Fischer, Greitemeyer, & Frey (2008, JPSP, Study 2)
        • Dataset
        • Study Materials
      • Replication of Williams & Bargh (2008, PS, Study 4)
        • Dataset
        • Study Materials
      • Replication of Bressan & Stranieri (2008, PS, Study 3)
        • Study Materials
        • Study Procedure
        • Cleaning & Analysis Scripts
        • Dataset
      • Replication of Vul et al (2008, PS, Study 1)
        • Study Materials
      • Online Replication of Exline, Baumeister, Zell, Kraft, & Witvliet (2008, JPSP, Study 7)
        • Dataset
        • Study Materials
      • Replication of Alter & Oppenheimmer (2008, PS, Study 2B)
        • Dataset
        • Study Materials
        • Report
      • Replication of Amodio, Devine, & Harmon-Jones (2008, JPSP, Study 2)
        • Study Materials
        • Study Materials
        • Dataset
      • Replication of Hajcak & Foti (2008, PS, Study 1)
        • Dataset
        • Study materials
        • Study Materials
      • Replication of Henderson, de Liver, & Gollwitzer (2008, JPSP, Study 5)
      • Replication of Blankenship & Wegener (2008, JPSP, Study 5A)
        • Data Set
        • Study Materials
      • Replication of Goschke & Dreisbach (2008, PS)
        • Study Materials
        • Dataset
    05/22/13 06:18 PM
    Joshua Foster updated wiki page home to version 17
    05/21/13 11:36 PM
    Elizabeth Bartmess added Leslie Cramblet Alvarez as contributor on node Reproducibility Project
    05/12/13 06:35 PM
    Matt Motyl tagged node Replication of Morrison & Miller (2008, JPSP, Study 3) as Morrison & Miller
    05/12/13 06:35 PM
    Matt Motyl removed tag miller from node Replication of Morrison & Miller (2008, JPSP, Study 3)
    05/12/13 06:35 PM
    Matt Motyl removed tag rios from node Replication of Morrison & Miller (2008, JPSP, Study 3)
    05/12/13 06:35 PM
    Matt Motyl tagged node Replication of Morrison & Miller (2008, JPSP, Study 3) as miller
    05/12/13 06:35 PM
    Matt Motyl tagged node Replication of Morrison & Miller (2008, JPSP, Study 3) as rios
    05/12/13 06:35 PM
    Matt Motyl tagged node Replication of Morrison & Miller (2008, JPSP, Study 3) as replication
    05/12/13 06:35 PM
    Matt Motyl tagged node Replication of Morrison & Miller (2008, JPSP, Study 3) as reproducibility project
    05/12/13 06:32 PM
    Matt Motyl updated file BumperStickerTallySheet.docx in node Replication of Morrison & Miller (2008, JPSP, Study 3)
    more