Rapid replications for reliable research
You may have noticed that one of the features of all of our replication reports is the “Study Diagram” near the top. Our Study Diagrams lay out the hypotheses, exactly what participants did in the study, the key findings, and whether those findings replicated. Why create a Study Diagram? We create a Study Diagram for…
Executive Summary Transparency Replicability Clarity 0 of 1 findings replicated* *Note: Lack of replication is likely due to an experimental design decision that made the study less sensitive to detecting the effect than was anticipated when the sample size was determined. We ran a replication of the experiment from this paper which found that as…
This is an opinion piece from our founder, Spencer Greenberg. A significant and pretty common problem I see when reading papers in social science (and psychology in particular) is that they present a fancy analysis but don’t show the results of what we have named the “Simplest Valid Analysis” – which is the simplest possible…
Executive Summary Transparency Replicability Clarity 4 of 4 findings replicated We ran a replication of Study 5b from this paper. This study tested whether people believe that morality is declining over time. The paper noted that people encounter disproportionately negative information about current-day people (e.g., via the media) and people often have weaker emotional responses…
Executive Summary Transparency Replicability Clarity 1 of 1 findings replicated We ran a replication of Study 2 from this paper, which found that participants place greater value on information in situations where they’ve been specifically assigned or “endowed with” that information compared to when they are not endowed with that information. This is the case…
Transparent Replications Founder Spencer Greenberg recently appeared on The Reality Check podcast. He talks about the state of replication in psychology, incentives in academic research, statistical methods, and how Transparent Replications is working to improve the reliability of research. Check it out!
Transparent Replications presented our project and preliminary results at the Year of Open Science Culminating Conference. This virtual conference was a collaboration between the Open Science Foundation and NASA and was attended by over 1,000 people. Now you can see our presentation too! The Transparent Replications presentation is the first fifteen minutes of this video.…
Executive Summary Transparency Replicability Clarity 10 of 10 findings replicated We ran a replication of Study 1 from this paper, which tested whether a series of popular logos and characters (e.g., Apple logo, Bluetooth symbol, Mr. Monopoly) showed a “Visual Mandela Effect”—a phenomenon where people hold “specific and consistent visual false memories for certain images…
Transparency Replicability Clarity We ran a replication of study 1 from this paper , which found that the variety in a person’s social interactions predicts greater well-being, even when controlling for their amount of in-person social interaction. This finding was replicated in our study. In this study participants were asked about their well-being over the…
TransparencyReplicabilityClarity We ran replications of studies three (3) and four (4) from this paper. These studies found that: People have less support for behavioral nudges (such as sending reminders about appointment times) to prevent failures to appear in court than to address other kinds of missed appointments People view missing court as more likely to…
Sigal Samuel’s article, “Lots of bad science still gets published. Here’s how we can change that.” in Vox today, highlights the work we’re doing at Transparent Replications to address the replication crisis in psychology research.”, in Vox today, highlights the work we’re doing at Transparent Replications to address the replication crisis in psychology research. If…
Listen to project founder, Spencer Greenberg, discuss Transparent Replications on the Two Psychologists Four Beers podcast. If you’ve found your way here from the podcast episode… [continue reading]
TransparencyReplicabilityClarity We ran a replication of study 2A from this paper, which tested whether knowing additional information about another person changed what participants thought the other person would know about them. The primary result in the original study failed to replicate. There was no relationship between whether participants were given information about their ‘partner’ and…