What if, instead of asking about pre-registration, we asked about "being transparent about (and documenting) the timing of decisions"? Does that make this question easier to answer? (Genuine Q)
-
-
Replying to @siminevazire
Probably, with right kind of lab notebook
@HannahSFraser@annemscheel@EliseGould1 reply 0 retweets 3 likes -
-
Replying to @SylvainCF @fidlerfm and
Version control like git can do this very well for text files.
2 replies 0 retweets 5 likes -
Replying to @o_guest @SylvainCF and
Re, version control, agree with
@o_guest there's an existing system to do this.@siminevazire yes, this makes the question easier to answer but that's because documenting decisions is only one aspect of this. We should be asking whether it is appropriate and in what form. (1)1 reply 3 retweets 5 likes -
Replying to @msvanarmy @o_guest and
I'm all for documenting decisions.
@AdamOsth and I discussed after the talk that a lot of people don't acknowledge this and then have nice "just so" stories which don't convey their thought process along the way. (2)1 reply 2 retweets 5 likes -
Replying to @msvanarmy @o_guest and
However, in addition to this, I think there is still contention regarding the process of developing models, where we go back and forth thinking about how to mathematically capture patterns in the data, and this being appropriate an wanting this acknowledged (3)
1 reply 2 retweets 7 likes -
Replying to @msvanarmy @o_guest and
but also not denying that this means we need to test it on additional datasets. In short, if we do adopt pre-registration in the computational modelling community, what form it will take is not clear, but deep discussions about it are good! (4)
1 reply 2 retweets 11 likes -
Replying to @msvanarmy @SylvainCF and
Exactly. We already have equivalent in spirit mechanisms in modelling for keeping track of what we do and for validating our results.
2 replies 0 retweets 5 likes -
Replying to @o_guest @msvanarmy and
For a second I read this and thought “wait what are spirit mechanisms?”
2 replies 0 retweets 5 likes
Goth modelers can help here. 
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.