What if all you need to explain the so-called replication crisis in fields like psych is natural heterogeneity when effects are measured repeatedly (due to unmeasured confounders) and misunderstanding of statistical power? If observed effects will vary even when we think we're running the exact same experiment, and replications are also underpowered, you don't necessarily need all the complicated theories about people trying to game things to explain why nothing seems to replicate. It's all just a massive misunderstanding of statistical power.
I think that would be funny. I bet Meehl would too.
Yes! While I think the reproduction crisis is largely overblown, I 100% agree that there are far more simpler explanations than those commonly put forward. To his credit, so did Meehl. Spoiler Alert: I’m going to spend all next week unpacking his version of your take.
What if all you need to explain the so-called replication crisis in fields like psych is natural heterogeneity when effects are measured repeatedly (due to unmeasured confounders) and misunderstanding of statistical power? If observed effects will vary even when we think we're running the exact same experiment, and replications are also underpowered, you don't necessarily need all the complicated theories about people trying to game things to explain why nothing seems to replicate. It's all just a massive misunderstanding of statistical power.
I think that would be funny. I bet Meehl would too.
Yes! While I think the reproduction crisis is largely overblown, I 100% agree that there are far more simpler explanations than those commonly put forward. To his credit, so did Meehl. Spoiler Alert: I’m going to spend all next week unpacking his version of your take.