It's complicated. Open code & open source doesn't actually solve (all) the scientific problems with respect to modelling, sadly. More here if you are interested:https://twitter.com/o_guest/status/1058725725531004930 …
-
-
Agreed! I don't want to argue that prereg can replace crossval, is better than it, or does exactly the same thing. There are some similarities in their utility though. Both are great tools given the right circumstances and should be used more often, when appropriate.
-
Modelling though is not the same as analysing data in a deep way. So prereg in the cases I can think of is not able to help with avoiding overfit.
-
Agreed.
-
I'm glad to see quite a few people like you who realise we're not trying to stop you overhauling the method in your (sub*)fields. We're all for open science. We just want to do it right in our (sub*)fields too.
-
That's a Kleene star, just in case.

- 1 more reply
New conversation -
-
-
That's if you want to be exhaustive and it's practical to do so. Another thing to bear in mind is that not all models are trained of course. In those cases other formal model selection techniques can be used.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
TFW somebody really gets how you do science (AKA is also a modeller).
"We believe that a hypothesis-centric approach is too impoverished to provide the necessary resources for a formal theory of such open practices."