I'm far from the first person to say this, but as a field but our intuitions about confirmatory research (what it's for, and what should happen when we do it) are wildly off thanks to the last many decades of published work, and I don't really know how you fix s.t. like that
-
-
Replying to @melissaekline @djnavarro
Yes, I use preregistration to increase confidence of interpretation even when exploratory - the skeptical reader can know that I did not do a infinitely-broad fishing expedition, they see the scope of the project, be it exploratory or confirmatory.
1 reply 0 retweets 2 likes -
If you were unethical, you could do all the fishing expeditions and then just preregister the ones that worked.
2 replies 0 retweets 1 like -
Yes if I also back-dated the data files. But risk being exposed if I left a trace or if someone manages to get their hands on ethics/IRB documents etc. I don't see it as different than ways to commit fraud with confirmatory prereg, but I might be missing something.
1 reply 0 retweets 0 likes -
We're in agreement. My point is that it seems people think new tools/methods, like prereg make it harder to cheat/game the system, but it certainly doesn't seem that way to me.
1 reply 0 retweets 0 likes -
I don't think it makes it harder for an unethical person to cheat, I think it makes it easier/more standardized for an ethical person to report the features of their work that make it more credible.
1 reply 0 retweets 0 likes -
Replying to @melissaekline @o_guest and
And it's not and never was designed to stop fraud. What it does do is push a lot of grey practices that academics do now over a line so that doing them in the context of prereg would be fraud.
1 reply 0 retweets 1 like -
Replying to @chrisdc77 @o_guest and
In my ideal world, a reviewer pressuring someone to add unwarranted confirmatory tests would be like a reviewer pressuring someone to claim a larger N. (Not like, to go collect more data, like 'These results would sound better if you had 60 subjects, why don't you write that?)
1 reply 0 retweets 0 likes -
Replying to @melissaekline @o_guest and
Agreed. Prereg achieves this because forcing HARKing on to an author who preregistered would be forcing them to lie.
1 reply 0 retweets 1 like
I'm glad you agree but I'm still concerned many don't get it (for whatever reason — it's not a nuanced point IMHO).
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.