Pre-registration formalizes Type 1 error rate control in hypothesis tests. That is all. With increasing adoption, one consequence is we will see an increase in people who realize they were not testing a hypothesis at all. That is progress.
-
-
Thanks for illustrating the misunderstanding people have voiced! This is not even remotely an argument to pre-register everything. You can submit a RR saying you will only do exploratory analyses (there is even an explicit exploratory RR
@chrisdc77). RR's prevent publication bias - 7 more replies
New conversation -
-
-
Perhaps you’ve misunderstood my opinion on journals. I don’t think pre-publication peer review by journals is necessary or even useful for much research except RRs. All the other (very valuable) research is better served by post-preprint peer review.
-
But this will require a shift away from using publication and JIF as shorthand ways to evaluate the quality or research. And ways to ensure that post-pub peer review is fairer than the current system (transparency will help, but not eliminate bias).
-
I think it’s hard for most people to even imagine a world where publication in a traditional journal isn’t necessary for good science, but I’m keen to explore if that can happen.
-
Ah, thanks for clarifying. I guess "most people" is relative. When I was on a panel at ICML they thought journals were a great idea. I did correct them this "grass is greener on the other side" mode of seeing neuro/psych.
-
So yeah, for a "no journals" science, see compsci, I guess? They haven't had journals since ever. They just do preprints and proceedings. Is that useful for you?
-
Compsci is a great example. The parts of psychology that are closer to compsci (e.g., that are testing computation models or using a data-driven approach) aren't well-served by either RRs or the journal-based publication model in general.
-
Yes, obviously. Something I've been saying on Twitter for years.
-
The tweet of yours I linked to comes off as saying that publications should all be RRs? But like I said above and you just also repeated, you have changed your perspective since you posted that.
- 5 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.