I'm sorry for being gone through this, but you did a better job of handling that than I would have. I've debated with Ben before and I absolutely get the sense that he would prefer to see all work as pre-registration even though I can't quote the tweet. And I predicted a muting.
-
-
Replying to @bradpwyble @o_guest and
I think it's fair to say that when someone says e.g. "Pre-reg doesn't prevent exploration" they are essentially supporting universal pre-reg (otherwise why say it?). And yet there is no specific tweet one can point to.
4 replies 2 retweets 7 likes -
Replying to @bradpwyble @zerdeve and
OK, I'll out myself. I've meant that when I've said that. I'm a grad student in social psych so I think pre reg is the bees knees. Can someone ELI5 why/when pre reg is not useful, when it does allow for exploratory research?
3 replies 1 retweet 3 likes -
Replying to @kymberlylouise_ @bradpwyble and
I would recommend that you go thru
@djnavarro’s and@IrisVanRooij’s recent threads, and also browse thru@o_guest’s and@JCSkewesDK’s TL’s. Many answers to your q have already been provided. You won’t find answers wrt social psych but def on many types of exploratory research.1 reply 0 retweets 6 likes -
Replying to @zerdeve @bradpwyble and
Thanks, I've been following them all but still don't really get it, probably because I only have the fuzziest understanding of what modelling is. I'll keep trying
2 replies 0 retweets 4 likes -
Replying to @kymberlylouise_ @zerdeve and
That's understandable. Thanks for being so open and clear.
1 reply 0 retweets 1 like -
Thanks! I've learnt so much from twitter that I just wouldn't be exposed to in my small university, I'm grateful to everyone that talks about these issues or I'd still be p hacking having no idea....
1 reply 0 retweets 4 likes -
Replying to @kymberlylouise_ @zerdeve and
In modelling we don't have p-values to hack. But we do replicate our work a lot for other reasons — implementation, model, specification, and theory evaluation — that are not discussed in the empirical discussions on replication.
1 reply 2 retweets 4 likes -
Replying to @o_guest @kymberlylouise_ and
This is something I've been explicitly taking about for years, and trying to engage on with empirical people, so I'm glad to see some interest.
1 reply 0 retweets 3 likes -
That sounds kind of cool, so you have 'built in' replications, compared with what seems to happen in my field of needing 'novelty' so moving on to the next study. Thankyou for engaging
1 reply 0 retweets 2 likes
I'm not sure about built-in. It depends on what you/we mean. The concept of replication is different, arguably quite a bit more complex, in modelling. In addition, a failure to replicate a model is again dealt with in a more complex way too.
-
-
Replying to @o_guest @kymberlylouise_ and
If I could be so bold at to suggest this as a starting point for more on exactly this: Guest, O. & Rougier, N. P. (2016). Dialogue: What is Computational Reproducibility?. IEEE CIS Newsletter on Cognitive and Developmental Systems. 13 (2). http://oliviaguest.com/doc/guest_rougier_2016.pdf …
2 replies 3 retweets 9 likes -
Replying to @o_guest @kymberlylouise_ and
This abstract might help too.https://figshare.com/articles/Varieties_of_Reproducibility_in_Empirical_and_Computational_Domains/6818018 …
0 replies 0 retweets 1 like
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.